-- Logs begin at Thu 2022-06-16 18:27:24 UTC, end at Thu 2022-06-16 20:07:35 UTC. -- Jun 16 19:34:45.021088 dv-cinder-846173-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 19:34:45.033919 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 19:34:45.035935 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 19:34:45 2022] *** Jun 16 19:34:45.035935 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 19:34:45.035935 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 19:34:45.035935 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: nodename: dv-cinder-846173-1-iscsi Jun 16 19:34:45.035935 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: machine: x86_64 Jun 16 19:34:45.035935 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: clock source: unix Jun 16 19:34:45.035935 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: pcre jit disabled Jun 16 19:34:45.035935 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: detected number of CPU cores: 4 Jun 16 19:34:45.035935 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: current working directory: / Jun 16 19:34:45.035935 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: detected binary path: /usr/bin/uwsgi-core Jun 16 19:34:45.035935 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: your processes number limit is 47680 Jun 16 19:34:45.035935 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: your memory page size is 4096 bytes Jun 16 19:34:45.035935 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: detected max file descriptor number: 2048 Jun 16 19:34:45.035935 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: lock engine: pthread robust mutexes Jun 16 19:34:45.037682 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: thunder lock: enabled Jun 16 19:34:45.037682 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 19:34:45.037682 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 19:34:45.086366 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: Python main interpreter initialized at 0x55e83e9ff9c0 Jun 16 19:34:45.086366 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: python threads support enabled Jun 16 19:34:45.086366 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: your server socket listen backlog is limited to 100 connections Jun 16 19:34:45.086366 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: your mercy for graceful operations on workers is 90 seconds Jun 16 19:34:45.086764 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 19:34:45.086858 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: *** Operational MODE: preforking *** Jun 16 19:34:45.087081 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: *** uWSGI is running in multiple interpreter mode *** Jun 16 19:34:45.087081 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: spawned uWSGI master process (pid: 110173) Jun 16 19:34:45.087291 dv-cinder-846173-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 19:34:45.087883 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: spawned uWSGI worker 1 (pid: 110174, cores: 1) Jun 16 19:34:45.088228 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: spawned uWSGI worker 2 (pid: 110175, cores: 1) Jun 16 19:34:45.088384 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 19:34:45.762088 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 19:34:45.768861 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 19:34:46.934443 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 19:34:46.934443 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: from cryptography.utils import int_from_bytes Jun 16 19:34:46.935508 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 19:34:46.935508 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: from cryptography.utils import int_from_bytes Jun 16 19:34:46.945112 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 19:34:46.945112 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: from cryptography.utils import int_from_bytes Jun 16 19:34:46.945581 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 19:34:46.945581 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: from cryptography.utils import int_from_bytes Jun 16 19:34:49.516281 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 19:34:49.516824 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 19:34:49.517034 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 19:34:49.517391 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 19:34:49.517647 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 19:34:49.518025 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.518343 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.518657 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.519010 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.519336 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.519642 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.519958 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.520278 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.520429 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 19:34:49.520810 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.520900 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 19:34:49.520972 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.521102 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 19:34:49.521206 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.521440 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846173-1-iscsi {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.521529 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 19:34:49.521695 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 19:34:49.521788 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.522044 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.522128 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.522347 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.522430 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.522656 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.522750 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.522975 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.523075 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.523298 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.523403 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.523598 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.523684 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.523934 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.524092 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.524253 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.524535 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.524638 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.524827 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.524928 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.525130 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.525217 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.525452 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846173-1-iscsi {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.525538 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.525760 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.525886 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.526061 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.526155 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.526371 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.526456 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.527243 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.527354 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.527563 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.527701 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.527856 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.528003 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.528157 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.528241 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846173-1-iscsi {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.528554 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.528646 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.528868 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.528966 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.529172 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.529269 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.529542 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.529641 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.529870 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.529998 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.530172 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.530265 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.530474 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.530575 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.530789 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.530874 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.531120 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.531219 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.531438 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.531550 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.531744 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.531832 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.532057 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.532153 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846173-1-iscsi {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.532373 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.532466 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.532672 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.532769 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.532976 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.533069 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.533278 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.533409 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.533590 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.533717 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.533886 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.534023 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.534186 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.534340 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.534434 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.534668 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.534760 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.534994 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.535085 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.535319 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.535414 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.535633 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.535720 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.535892 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.535979 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.536139 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.536249 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.536453 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.536540 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.536768 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.536854 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.537073 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.537160 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.537375 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.537471 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.537677 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.537819 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.537977 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.538077 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.538246 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.538337 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.538552 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.538647 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.538862 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.539036 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.539191 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.539278 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.539503 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.539600 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.539751 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.539837 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.540000 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.540095 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.540314 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.540402 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.540632 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.540719 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.540940 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.541078 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.541245 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.541332 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.541549 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.541634 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.541852 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.541938 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.542177 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.542264 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.542480 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.542572 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.542781 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.542882 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.543111 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.543199 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.543426 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.543511 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.543736 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.543835 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.544036 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.544122 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.544343 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.544440 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.544657 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.544752 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.544954 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.545046 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.545200 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.545285 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.545494 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.545590 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.545791 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.545905 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.546102 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.546220 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.546400 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.546586 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.546697 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.547017 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.547112 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.547312 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.547411 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.547611 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.547696 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.547908 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.548047 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.548208 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.548304 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.548506 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.548593 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.548809 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.548895 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.549104 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.549206 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.549403 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.549497 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.549701 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.549786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.549996 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.550096 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.550309 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.550393 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.550618 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.550703 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.550945 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.551033 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.551240 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.551335 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.551535 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.551620 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.551832 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.551928 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.552133 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.552217 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.552431 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.552522 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.552731 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.552817 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.553034 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.553124 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.553328 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.553421 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.553625 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.553720 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.553926 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.554010 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.554223 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.554315 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.554523 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.554616 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.554832 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.554945 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.555148 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.555242 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.555449 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.555535 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.555751 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.555846 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.556050 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.556141 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.556348 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.556441 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.556643 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.556729 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.556939 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.557025 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.557235 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.557335 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.557531 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.557616 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.558343 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.558448 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.558639 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.558724 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.558941 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.559056 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.559272 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.559397 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.559585 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.559712 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.559883 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.559978 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.560435 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.560536 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.560734 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.560819 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.561038 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.561124 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.561364 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.561457 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.561688 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.561781 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.561986 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.562079 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.562320 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.562406 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.562648 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.562735 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.562965 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.563053 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.563269 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.563357 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.563566 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.563651 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.563877 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.563962 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.564194 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.564282 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.564497 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.564581 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.564796 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.564888 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.565096 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.565189 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.565405 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.565492 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:34:49.565719 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.565813 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.566042 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.566150 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.566350 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.566437 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.566660 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.566755 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.566993 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.567083 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.567302 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.567389 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.567614 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.567712 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.567937 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.568053 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.568251 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.568337 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.568554 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.568656 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.568871 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.568956 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.569180 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.569265 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.569490 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.569589 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.569807 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.569893 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.570118 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.570202 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.570423 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.570522 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.570728 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.570815 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.571057 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.571148 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.571373 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.571460 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.571682 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.571777 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.571989 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.572073 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.572300 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.572388 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.572606 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.572693 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.572912 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.573032 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.573215 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.573303 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.574095 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.574192 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.574405 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.574492 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.574738 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.574826 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.575077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.575179 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.575387 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.575481 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.575692 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.575778 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.575995 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.576080 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.576299 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.576391 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.576603 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.576695 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.576908 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.577001 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.577207 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.577302 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.577506 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.577592 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.577808 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.577896 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.578114 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.578210 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.578414 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.578539 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.578722 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.578807 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.579070 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.579170 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.579380 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.579519 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.579694 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.579787 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.579997 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.580084 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.580302 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.580388 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.580608 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.580694 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.580914 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.581037 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.581214 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.581307 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.581514 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.581599 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.581818 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.582020 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.582106 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.582326 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.582411 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.582648 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.582736 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.582992 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.583130 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.583282 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.583371 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.583602 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.583690 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.583902 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.583988 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.584200 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.584287 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.584513 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.584600 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.584820 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.584906 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.585126 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.585225 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.585434 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.585529 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.585741 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.585827 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.586048 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.586147 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.586354 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.586448 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.586660 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.586745 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.586999 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.587098 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.587315 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.587401 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.587618 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.587703 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.587929 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.588022 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.588232 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.588319 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.588543 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.588664 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.588842 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.588941 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.589175 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.589245 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.589468 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.589590 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.589766 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.589856 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.590062 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.590147 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.590366 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.590453 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.590663 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.590757 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.591019 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.591189 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.591353 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.591491 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.591660 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.591790 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.591982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.592088 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.592303 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.592389 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.592618 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.592706 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.592920 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.593005 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.593225 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.593319 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.593527 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.593621 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.593831 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.593917 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.594133 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.594228 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.594438 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.594525 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.594739 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.594831 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.595064 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.595172 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.595366 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.595460 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.595667 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.595754 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.595970 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.596067 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.596290 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.596378 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.596595 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.596681 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.596895 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.596983 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.597199 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.597284 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.597499 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.597599 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.597839 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.597918 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.598143 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.598220 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.598445 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.598560 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.598763 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.598841 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.599091 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.599183 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.599406 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.599493 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.599705 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.599801 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.600014 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.600105 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.600326 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.600413 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.600637 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.600732 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.600945 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.601031 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.601254 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.601348 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.601572 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.601659 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.601881 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.601968 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.602199 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.602366 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.602506 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.602591 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.602810 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.602905 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.603140 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.603241 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.603454 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.603537 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.603754 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.603836 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.604066 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.604152 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.604367 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.604560 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.604706 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.604790 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.605010 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.605087 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.605351 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.605426 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.605661 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.605736 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.605980 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.606107 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.606289 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.606399 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.606597 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.606692 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.606905 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.607022 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.607235 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.607321 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.607569 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.607656 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.607855 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.607942 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.608158 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.608245 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.608462 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.608557 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.608760 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.608847 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.609058 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.609186 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.609361 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.609459 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.609668 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.609796 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.609974 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.610071 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.610278 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.610380 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.610578 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.610672 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.610886 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.611005 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.611211 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.611308 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.611509 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.611596 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.611807 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.611892 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.612109 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.612204 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.612417 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.612503 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.612720 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.612815 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.613021 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.613109 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.613329 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.613416 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.613626 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.613711 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.613922 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.614016 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.614229 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.614315 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.614529 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.614615 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.614831 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.614978 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.615156 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.615280 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.615458 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.615546 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.615759 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.615846 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.616066 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.616160 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.616372 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.616465 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.616680 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.616765 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.616993 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.617121 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.617299 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.617396 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.617601 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.617688 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.617902 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.617995 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.618203 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.618302 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.618508 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.618594 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.618809 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.618895 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.619134 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.619235 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.619435 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.619521 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.619743 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.619828 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.620049 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.620140 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.620889 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.620979 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.621206 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.621291 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.621508 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.621602 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.621814 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.621901 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.622120 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.622206 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.622421 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.622508 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.622725 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.622814 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.623060 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.623150 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.623372 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.623635 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.623721 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.623964 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.624051 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.624271 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.624358 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.624580 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.624667 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.624888 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.624982 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.625200 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.625287 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.625505 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.625600 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.625811 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.625897 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.626117 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.626205 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.626419 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.626515 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.626728 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.626815 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.627059 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.627159 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.627363 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.627630 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.627716 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.627954 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.628046 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.628255 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.628343 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.628553 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.628640 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.628855 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.628950 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.629153 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.629243 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.629450 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.629536 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.629746 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.629841 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.630042 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.630135 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.630358 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.630454 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.630657 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.630745 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.630984 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.631076 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.631286 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.631381 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.631603 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.631690 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.631906 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.632001 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.632206 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.632300 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.632504 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.632589 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.632801 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.632889 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.633102 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.633186 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.633406 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.633494 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.633708 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.633802 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.634011 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.634098 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.634324 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.634419 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.634627 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.634715 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.634944 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.635044 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.635262 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.635362 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.635559 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.635646 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.635965 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.636551 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.636765 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.636860 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.637067 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.637160 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.637367 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.637451 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.637666 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.637760 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.637972 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.638059 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.638276 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.638369 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.638580 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.638671 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.638881 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.638987 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.639200 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.639288 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.639502 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.639590 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.639800 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.639886 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.640109 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.640195 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.640419 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.640506 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.640716 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.640803 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.641010 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.641103 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.641312 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.641406 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.641613 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.641745 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.641909 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.642015 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.642211 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.642306 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.642506 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.642592 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.642809 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.642904 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.643132 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.643220 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.643430 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.643516 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.643771 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.643875 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.644030 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.644118 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.644329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.644415 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.644628 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.644722 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.644929 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.645025 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.645231 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.645316 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.645527 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.645659 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.645826 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.645913 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.646126 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.646212 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.646425 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.646511 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.646720 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.646806 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.647046 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.647138 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.647352 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.647453 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.647653 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.647739 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.647949 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.648036 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.648252 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.648342 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.648548 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.648640 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.648847 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.648943 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.649145 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.649233 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.649445 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.649532 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.649738 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.649831 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.650035 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.650122 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.650332 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.650418 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.650628 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.650722 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.650971 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.651063 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.651263 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.651366 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.651589 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.651690 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.651890 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.651981 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.652188 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.652488 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.652621 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.652825 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.652918 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.653123 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.653217 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.653437 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.653532 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.653747 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.653834 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.654051 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.654141 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.654355 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.654452 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.654657 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.654744 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.654981 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.655070 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.655288 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.655458 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.655585 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.655709 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.655895 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.655982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.656196 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.656283 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.656499 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.656587 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.656796 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.656888 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.657095 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.657184 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.657412 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.657506 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.657718 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.657812 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.658022 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.658110 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.658337 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.658424 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.658652 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.658739 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.658984 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.659073 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.659283 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.659369 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.659634 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.659749 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.659888 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.660226 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.660226 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.660362 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.660482 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.660577 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.660784 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.660872 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.661082 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.661167 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.661384 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.661479 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.661688 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.661774 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.661992 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.662083 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.662296 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.662393 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.662597 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.662684 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.662899 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.663054 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.663226 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.663332 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.663528 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.663615 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.663837 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.663923 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.664141 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.664234 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.664440 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.664537 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.664743 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.664830 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.665040 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.665126 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.665346 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.665432 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.665641 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.665763 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.665951 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.666054 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.666262 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.666348 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.666570 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.666663 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.666876 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.667018 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.667233 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.667321 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.667541 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.667636 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.667846 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.667932 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.668162 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.668249 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.668461 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.668558 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.668763 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.668872 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.669072 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.669180 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.669377 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.669479 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.669687 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.669811 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.669989 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.670077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.670350 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.670481 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.670656 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.670743 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.670996 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.671085 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.671296 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.671385 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.671596 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.671684 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.671894 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.672023 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.672212 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.672307 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.672512 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.672598 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.672823 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.672907 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.673230 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.673317 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.673535 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.673628 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.673832 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.673926 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.674141 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.674235 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.674444 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.674532 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.674748 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.674843 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.675087 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.675176 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.675410 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.675497 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.675715 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.675813 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.676018 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.676104 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.676319 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.676406 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.676635 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.676729 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.676936 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.677021 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.677255 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.677341 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.677558 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.677657 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.677865 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.677952 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.678164 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.678271 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.678482 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.678659 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.678798 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.678993 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.679133 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.679305 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.679452 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.679626 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.679859 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.679947 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.680178 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.680265 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.680492 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.680634 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.680808 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.680897 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.681125 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.681212 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.681424 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.681512 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.681724 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.681820 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.682028 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.682122 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.682326 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.682411 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.682626 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.683337 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.683504 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.683592 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.683806 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.683907 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.684113 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.684200 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.684418 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.684504 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.684722 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.684842 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.685021 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.685418 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.685576 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.685731 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.685894 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.686052 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.686194 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.686377 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.686511 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.686682 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.686821 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.687009 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.687161 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.687320 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.687476 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.687623 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.687778 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.687925 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.688095 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.688247 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.688398 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.688551 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.688698 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.688860 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.688995 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.689170 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.689294 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.689477 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.689631 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.689779 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.689932 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.690081 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.690248 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.690403 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.690573 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.690706 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.690902 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.691051 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.691230 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.691362 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.691560 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.691683 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.691885 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.691973 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.692197 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.692293 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.692511 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.692597 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.692830 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.692918 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.693129 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.693227 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.693430 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.693523 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.693731 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.693817 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.694030 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.694129 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.694331 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.694417 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.694630 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.694724 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.694979 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.695084 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.695259 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.695347 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.695561 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.695648 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.695861 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.695949 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.696180 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.696266 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.696481 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.696567 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.696799 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.696886 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.697103 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.697203 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.697404 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.697505 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.697705 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.697791 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.698001 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.698088 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.698305 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.698973 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.699207 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.699334 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.699515 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.699606 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.699825 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.699930 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.700126 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.700219 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.700429 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.700519 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.700730 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.700826 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.701052 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.701140 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.701355 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.701442 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.701664 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.701752 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.701970 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.702055 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.702272 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.702358 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.702580 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.702669 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.702879 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.703009 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.703214 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.703299 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.703518 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.703614 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.703830 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.703917 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.704140 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.704228 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.704453 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.704548 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.704776 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.704969 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.705084 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.705297 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.705393 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.705611 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.705699 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.705922 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.706010 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.706233 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.706320 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.706542 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.706636 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.706851 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.706962 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.707185 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.707275 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.707493 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.707587 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.707801 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.707889 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.708107 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.708202 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.708417 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.708510 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.708733 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.708832 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.709052 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.709249 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.709383 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.709574 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.709697 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.709887 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.710007 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.710199 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.710318 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.710509 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.710628 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.710822 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.711005 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.711158 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.711316 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.711469 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.711619 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.711777 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.711929 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.712083 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.712239 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.712391 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.712551 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.712721 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.712859 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.713039 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.713164 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.713363 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.713459 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.713696 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.713783 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.714031 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.714127 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.714345 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.714440 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.714659 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.714745 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.714990 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.715082 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.715310 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.715399 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.715641 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.715729 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.715943 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.716090 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.716254 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.716378 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.716561 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.716649 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.716872 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.716966 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.717182 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.717382 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.717489 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.717690 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.717784 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.718021 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.718117 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.718342 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.718429 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.718663 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.718757 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.718999 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.719091 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.719312 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.719400 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.719630 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.719724 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.719932 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.720018 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.720234 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.720373 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.720541 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.720639 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.720850 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.720936 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.721151 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.721281 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.721468 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.721663 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.721774 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.721973 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.722060 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.722303 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.722399 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.722631 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.722726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.722971 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.723208 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.723308 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.723554 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.723642 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.723865 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.723951 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.724187 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.724273 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.724489 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.724576 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.724796 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.724883 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.725097 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.725192 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.725396 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.725482 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.725707 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.725793 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.726009 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.726104 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.726308 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.726444 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.726617 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.726711 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.726953 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.727058 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.727241 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.727467 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.727561 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.727814 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.727902 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.728127 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.728214 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.728433 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.728528 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.728732 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.728828 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.729056 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.729144 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.729359 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.729444 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.729683 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.729780 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.729985 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.730072 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.730289 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.730374 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.730591 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.730690 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.730892 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.731055 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.731218 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.731304 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.731519 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.731614 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.731824 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.731911 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.732123 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.732208 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.732422 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.732518 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.732720 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.732806 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.733025 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.733119 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.733325 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.733412 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.733632 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.733725 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.733933 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.734020 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.734237 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.734325 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.734547 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.734634 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.734849 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.734969 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.735176 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.735265 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.735479 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.735566 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.735780 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.735876 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.736089 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.736176 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.736392 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.736478 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.736700 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.736795 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.737002 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.737088 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.737311 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.737541 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.737628 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.737872 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.738544 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.738628 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.738707 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.738794 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.738875 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.739054 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.739146 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.739233 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.739312 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.739419 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.739516 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.739720 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.739806 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.740041 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.740127 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.740349 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.740446 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.740659 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.740748 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.740966 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.741053 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.741272 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.741372 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.741577 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.741818 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.741906 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.742151 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.742239 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.742466 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.742554 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.742770 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.742857 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.743100 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.743203 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.743405 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.743493 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.743709 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.743795 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.744012 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.744110 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.744321 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.744408 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.744631 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.744724 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.744941 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.745038 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.745775 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.745871 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.746083 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.746168 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.746390 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.746477 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.746694 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.746781 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.747020 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.747122 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.747325 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.747413 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.747630 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.747725 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.747935 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.748024 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.748242 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.748344 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.748549 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.748635 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.748849 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.748944 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.749158 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.749245 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.749496 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.749583 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.749816 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.749916 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.750132 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.750219 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.750442 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.750527 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.750756 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.750856 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.751087 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.751188 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.751395 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.751482 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.751702 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.751797 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.752005 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.752099 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.752315 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.752400 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.752643 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.752730 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.752957 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.753042 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.753261 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.753347 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.753561 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.753678 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.753860 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.753990 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.754161 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.754307 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.754465 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.754628 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.754779 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.754953 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.755109 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.755281 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.755408 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.755604 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.755690 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.755916 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.756003 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.756237 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.756325 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.756548 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.756634 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.756849 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.756937 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.757146 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.757235 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.757447 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.757541 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.757745 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.757840 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.758042 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.758136 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.758341 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.758428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.758640 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.758735 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.758957 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.759045 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.759259 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.759346 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.759563 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.759662 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.759862 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.759955 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.760161 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.760248 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.760457 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.760552 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.760754 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.760884 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.761706 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.761788 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.761917 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.762013 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.762222 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.762310 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.762529 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.762616 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.762832 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.762958 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.763164 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.763254 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.763465 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.763559 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.763770 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.763857 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.764074 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.764160 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.764376 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.764463 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.764685 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.764772 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.764986 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.765070 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.765290 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.765391 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.765594 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.765680 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.765896 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.765982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.766195 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.766333 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.766499 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.766587 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.766805 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.766977 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.767136 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.767234 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.767455 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.767549 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.767771 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.767856 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.768069 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.768157 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.768386 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.768472 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.768698 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.768785 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.769011 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.769099 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.769318 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.769405 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.769623 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.769711 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.769946 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.770034 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.770251 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.770338 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.770552 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.770646 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.770860 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.770976 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.771187 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.771274 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.771491 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.771587 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.771800 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.771888 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.772105 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.772191 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.772425 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.772525 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.772728 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.772814 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.773037 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.773123 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.773357 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.773456 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.773670 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.773757 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.773984 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.774078 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.774292 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.774380 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.774619 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.774712 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.774962 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.775054 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.775254 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.775343 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.775560 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.775653 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.775861 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.775949 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.776102 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 19:34:49.776191 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.776489 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.776805 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.777132 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.777456 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.777764 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.778089 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.778416 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.778761 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.779112 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.779456 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.779782 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.780096 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.780406 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.780709 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:34:49.780952 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 19:34:49.838170 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO dbcounter [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] Registered counter for database nova_api Jun 16 19:34:49.843341 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO dbcounter [None req-f5bc4e0a-a160-4aca-8780-fa8faf6ae6b4 None None] Registered counter for database nova_api Jun 16 19:34:49.858272 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_db.sqlalchemy.engines [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 19:34:49.862337 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG oslo_db.sqlalchemy.engines [None req-f5bc4e0a-a160-4aca-8780-fa8faf6ae6b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110175) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 19:34:49.864920 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG dbcounter [-] [110174] Writer thread running {{(pid=110174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 19:34:49.868770 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG dbcounter [-] [110175] Writer thread running {{(pid=110175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 19:34:49.922184 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.context [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cb00b46e-9042-4ea9-a634-b4f1cf1f3046(cell1) {{(pid=110174) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 19:34:49.925544 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.context [None req-f5bc4e0a-a160-4aca-8780-fa8faf6ae6b4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cb00b46e-9042-4ea9-a634-b4f1cf1f3046(cell1) {{(pid=110175) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 19:34:49.926296 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:49.927915 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:49.928701 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:49.929624 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG oslo_concurrency.lockutils [None req-f5bc4e0a-a160-4aca-8780-fa8faf6ae6b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:49.930635 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:49.931225 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG oslo_concurrency.lockutils [None req-f5bc4e0a-a160-4aca-8780-fa8faf6ae6b4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:49.932020 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG oslo_concurrency.lockutils [None req-f5bc4e0a-a160-4aca-8780-fa8faf6ae6b4 None None] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:34:49.932609 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO dbcounter [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] Registered counter for database nova_cell0 Jun 16 19:34:49.934513 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG oslo_concurrency.lockutils [None req-f5bc4e0a-a160-4aca-8780-fa8faf6ae6b4 None None] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:34:49.936776 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO dbcounter [None req-f5bc4e0a-a160-4aca-8780-fa8faf6ae6b4 None None] Registered counter for database nova_cell0 Jun 16 19:34:49.937244 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO dbcounter [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] Registered counter for database nova_cell1 Jun 16 19:34:49.940538 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO dbcounter [None req-f5bc4e0a-a160-4aca-8780-fa8faf6ae6b4 None None] Registered counter for database nova_cell1 Jun 16 19:34:49.945667 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_db.sqlalchemy.engines [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 19:34:49.946432 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_db.sqlalchemy.engines [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 19:34:49.949365 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG oslo_db.sqlalchemy.engines [None req-f5bc4e0a-a160-4aca-8780-fa8faf6ae6b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110175) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 19:34:49.951009 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG oslo_db.sqlalchemy.engines [None req-f5bc4e0a-a160-4aca-8780-fa8faf6ae6b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110175) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 19:34:49.952606 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG dbcounter [-] [110174] Writer thread running {{(pid=110174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 19:34:49.955181 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG dbcounter [-] [110174] Writer thread running {{(pid=110174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 19:34:49.958532 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG dbcounter [-] [110175] Writer thread running {{(pid=110175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 19:34:49.958868 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG dbcounter [-] [110175] Writer thread running {{(pid=110175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 19:34:50.096964 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO dbcounter [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] Registered counter for database nova_cell0 Jun 16 19:34:50.102181 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO dbcounter [None req-f5bc4e0a-a160-4aca-8780-fa8faf6ae6b4 None None] Registered counter for database nova_cell0 Jun 16 19:34:50.106029 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_db.sqlalchemy.engines [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 19:34:50.110301 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG dbcounter [-] [110174] Writer thread running {{(pid=110174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 19:34:50.111338 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG oslo_db.sqlalchemy.engines [None req-f5bc4e0a-a160-4aca-8780-fa8faf6ae6b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110175) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 19:34:50.115621 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG dbcounter [-] [110175] Writer thread running {{(pid=110175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 19:34:50.548304 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: WARNING keystonemiddleware.auth_token [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 19:34:50.555644 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: WARNING keystonemiddleware.auth_token [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 19:34:50.654412 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: WARNING keystonemiddleware.auth_token [None req-f5bc4e0a-a160-4aca-8780-fa8faf6ae6b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 19:34:50.661480 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: WARNING keystonemiddleware.auth_token [None req-f5bc4e0a-a160-4aca-8780-fa8faf6ae6b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 19:34:50.892736 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: WARNING keystonemiddleware.auth_token [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 19:34:50.899535 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: WARNING keystonemiddleware.auth_token [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 19:34:50.905554 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e83e9ff9c0 pid: 110174 (default app) Jun 16 19:34:50.907666 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:34:50.908871 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001790 Jun 16 19:34:50.909296 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Thu Jun 16 19:34:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:34:50.995862 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: WARNING keystonemiddleware.auth_token [None req-f5bc4e0a-a160-4aca-8780-fa8faf6ae6b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 19:34:51.001738 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: WARNING keystonemiddleware.auth_token [None req-f5bc4e0a-a160-4aca-8780-fa8faf6ae6b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 19:34:51.007014 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e83e9ff9c0 pid: 110175 (default app) Jun 16 19:36:09.475393 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:09.477029 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002203 Jun 16 19:36:09.477684 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 930 bytes} [Thu Jun 16 19:36:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:09.496571 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG dbcounter [-] [110175] Writing DB stats nova_api:SELECT=3 {{(pid=110175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:36:09.498107 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG dbcounter [-] [110175] Writing DB stats nova_cell0:SELECT=3 {{(pid=110175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:36:09.499179 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG dbcounter [-] [110175] Writing DB stats nova_cell1:SELECT=3 {{(pid=110175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:36:09.500422 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG dbcounter [-] [110175] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:36:09.943183 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-2136a3a9-0865-466d-a299-042799a6e2a3 admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:09.972446 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-2136a3a9-0865-466d-a299-042799a6e2a3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.485798 Jun 16 19:36:09.973293 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1291 bytes} [Thu Jun 16 19:36:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:36:12.161731 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:12.162708 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-1e79bfd6-e6a9-490f-8f67-89baf6a1075e None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001391 Jun 16 19:36:12.163315 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 3/4] 10.222.0.36 () {54 vars in 930 bytes} [Thu Jun 16 19:36:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:12.233967 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-f439f566-b816-4264-a23e-d66ae7956cc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:12.252423 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:36:12.252423 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: warnings.warn(msg) Jun 16 19:36:12.370734 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-f439f566-b816-4264-a23e-d66ae7956cc4 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.201288 Jun 16 19:36:12.371576 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 2/5] 10.222.0.36 () {64 vars in 1282 bytes} [Thu Jun 16 19:36:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:36:12.385638 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG dbcounter [-] [110174] Writing DB stats nova_api:SELECT=3 {{(pid=110174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:36:12.386779 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG dbcounter [-] [110174] Writing DB stats nova_cell0:SELECT=3 {{(pid=110174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:36:12.387652 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG dbcounter [-] [110174] Writing DB stats nova_cell1:SELECT=3 {{(pid=110174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:36:12.388491 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG dbcounter [-] [110174] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:36:12.588046 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-dcf80519-f651-4ceb-99d4-10c54069b990 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:12.590414 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:36:12.590414 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: warnings.warn(msg) Jun 16 19:36:12.728824 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-dcf80519-f651-4ceb-99d4-10c54069b990 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.349237 Jun 16 19:36:12.729780 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 4/6] 10.222.0.36 () {64 vars in 1335 bytes} [Thu Jun 16 19:36:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:36:14.888883 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-f439f566-b816-4264-a23e-d66ae7956cc4 admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:14.889916 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-f439f566-b816-4264-a23e-d66ae7956cc4 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 16 19:36:14.890320 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 3/7] 10.222.0.36 () {54 vars in 930 bytes} [Thu Jun 16 19:36:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:15.011361 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-cf7313cc-931c-402b-aeb2-38d579d81d72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:15.030383 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:36:15.030383 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: warnings.warn(msg) Jun 16 19:36:15.148696 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-cf7313cc-931c-402b-aeb2-38d579d81d72 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.252223 Jun 16 19:36:15.149255 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 5/8] 10.222.0.36 () {64 vars in 1282 bytes} [Thu Jun 16 19:36:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:36:15.161074 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-c2f7aa78-0a07-42cb-8431-153804df11d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:15.162650 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:36:15.162650 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: warnings.warn(msg) Jun 16 19:36:15.261013 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-c2f7aa78-0a07-42cb-8431-153804df11d5 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103599 Jun 16 19:36:15.261687 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 4/9] 10.222.0.36 () {64 vars in 1335 bytes} [Thu Jun 16 19:36:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:36:17.434684 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-cf7313cc-931c-402b-aeb2-38d579d81d72 admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:17.435644 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-cf7313cc-931c-402b-aeb2-38d579d81d72 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 16 19:36:17.436191 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 930 bytes} [Thu Jun 16 19:36:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:17.496607 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-03a9c051-f465-4249-b5f5-ee719d9b52aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:17.598535 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-03a9c051-f465-4249-b5f5-ee719d9b52aa admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156635 Jun 16 19:36:17.601055 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 5/11] 10.222.0.36 () {64 vars in 1282 bytes} [Thu Jun 16 19:36:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 19:36:17.613793 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-8458dce6-7e00-4af9-b7c9-b3b80b65e118 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:17.693658 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-8458dce6-7e00-4af9-b7c9-b3b80b65e118 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085045 Jun 16 19:36:17.695616 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 7/12] 10.222.0.36 () {64 vars in 1335 bytes} [Thu Jun 16 19:36:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:36:19.916903 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-03a9c051-f465-4249-b5f5-ee719d9b52aa admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:19.917927 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-03a9c051-f465-4249-b5f5-ee719d9b52aa admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 16 19:36:19.918338 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 6/13] 10.222.0.36 () {54 vars in 930 bytes} [Thu Jun 16 19:36:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:19.980199 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-33fed256-d80f-4996-a5ea-7cbc57bd9b1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:20.061357 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-33fed256-d80f-4996-a5ea-7cbc57bd9b1b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.136409 Jun 16 19:36:20.061932 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 8/14] 10.222.0.36 () {64 vars in 1282 bytes} [Thu Jun 16 19:36:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:36:20.074112 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-6951a987-885c-408f-b65d-cb4c55692060 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:20.151802 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-6951a987-885c-408f-b65d-cb4c55692060 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081276 Jun 16 19:36:20.152401 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 7/15] 10.222.0.36 () {64 vars in 1335 bytes} [Thu Jun 16 19:36:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:36:22.335745 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-33fed256-d80f-4996-a5ea-7cbc57bd9b1b admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:22.336744 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-33fed256-d80f-4996-a5ea-7cbc57bd9b1b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 16 19:36:22.337311 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 9/16] 10.222.0.36 () {54 vars in 930 bytes} [Thu Jun 16 19:36:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:22.395873 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-5151c0f2-1ded-4b18-abba-707a0f2d4a1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "id": "d4", "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:22.468771 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-5151c0f2-1ded-4b18-abba-707a0f2d4a1d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.125743 Jun 16 19:36:22.469686 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 8/17] 10.222.0.36 () {64 vars in 1282 bytes} [Thu Jun 16 19:36:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:36:22.481517 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-179545dd-3669-4b20-a3b1-0d7a0f22bfcb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:22.547433 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-179545dd-3669-4b20-a3b1-0d7a0f22bfcb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069197 Jun 16 19:36:22.548553 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 10/18] 10.222.0.36 () {64 vars in 1335 bytes} [Thu Jun 16 19:36:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:36:24.718719 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-5151c0f2-1ded-4b18-abba-707a0f2d4a1d admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:24.719756 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-5151c0f2-1ded-4b18-abba-707a0f2d4a1d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 16 19:36:24.720327 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 9/19] 10.222.0.36 () {54 vars in 930 bytes} [Thu Jun 16 19:36:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:24.781730 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-ead2b483-ec3d-4e80-8a35-c44af33b004f admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:24.806031 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-ead2b483-ec3d-4e80-8a35-c44af33b004f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079933 Jun 16 19:36:24.806582 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 11/20] 10.222.0.36 () {60 vars in 1291 bytes} [Thu Jun 16 19:36:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:36:27.033784 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-5151c0f2-1ded-4b18-abba-707a0f2d4a1d admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:27.034803 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-5151c0f2-1ded-4b18-abba-707a0f2d4a1d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 16 19:36:27.035233 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 10/21] 10.222.0.36 () {54 vars in 930 bytes} [Thu Jun 16 19:36:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:27.101672 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-2bae1a55-4ba5-401c-b743-5cff15c766ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "id": "1", "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:27.182273 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-2bae1a55-4ba5-401c-b743-5cff15c766ea admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.140551 Jun 16 19:36:27.183389 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 12/22] 10.222.0.36 () {64 vars in 1282 bytes} [Thu Jun 16 19:36:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:36:27.195129 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-ac085792-823c-4bc8-b396-9a8fab4abf82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:27.274475 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-ac085792-823c-4bc8-b396-9a8fab4abf82 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082747 Jun 16 19:36:27.274968 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 11/23] 10.222.0.36 () {64 vars in 1332 bytes} [Thu Jun 16 19:36:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:36:29.516307 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-2bae1a55-4ba5-401c-b743-5cff15c766ea admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:29.517316 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-2bae1a55-4ba5-401c-b743-5cff15c766ea admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 16 19:36:29.521847 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 930 bytes} [Thu Jun 16 19:36:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:29.578382 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-21e28ba4-8552-43ea-b4dd-dfb4ae623a3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "2", "disk": 20, "os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:29.645148 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-21e28ba4-8552-43ea-b4dd-dfb4ae623a3f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.120831 Jun 16 19:36:29.645587 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 12/25] 10.222.0.36 () {64 vars in 1282 bytes} [Thu Jun 16 19:36:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:36:29.662584 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-8414906e-f546-4876-b2c8-5a1eb8d834cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:29.768437 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-8414906e-f546-4876-b2c8-5a1eb8d834cf admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113339 Jun 16 19:36:29.769522 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 14/26] 10.222.0.36 () {64 vars in 1332 bytes} [Thu Jun 16 19:36:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:36:32.633976 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-21e28ba4-8552-43ea-b4dd-dfb4ae623a3f admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:32.635139 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-21e28ba4-8552-43ea-b4dd-dfb4ae623a3f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jun 16 19:36:32.635763 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 930 bytes} [Thu Jun 16 19:36:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:32.692699 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-5a74c48b-056a-4344-ac66-07c6e06dc9a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "disk": 40, "ram": 4096}} {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:32.860430 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-5a74c48b-056a-4344-ac66-07c6e06dc9a4 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.218891 Jun 16 19:36:32.860910 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 15/28] 10.222.0.36 () {64 vars in 1282 bytes} [Thu Jun 16 19:36:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 19:36:32.873143 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-4a8c66c0-bd9b-4943-816c-cc6d493e8637 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:32.954946 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-4a8c66c0-bd9b-4943-816c-cc6d493e8637 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085469 Jun 16 19:36:32.955533 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 14/29] 10.222.0.36 () {64 vars in 1332 bytes} [Thu Jun 16 19:36:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:36:35.111392 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-5a74c48b-056a-4344-ac66-07c6e06dc9a4 admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:35.113280 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-5a74c48b-056a-4344-ac66-07c6e06dc9a4 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002363 Jun 16 19:36:35.113685 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 930 bytes} [Thu Jun 16 19:36:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:35.178075 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-17661b0a-a814-4950-8e55-a46b3dd93bea admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "rxtx_factor": 1.0, "disk": 80}} {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:35.257658 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-17661b0a-a814-4950-8e55-a46b3dd93bea admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.137429 Jun 16 19:36:35.258579 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 15/31] 10.222.0.36 () {64 vars in 1282 bytes} [Thu Jun 16 19:36:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:36:35.272107 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-e247723b-1947-479f-adcb-897f34919d85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:35.360495 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-e247723b-1947-479f-adcb-897f34919d85 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093470 Jun 16 19:36:35.363129 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1332 bytes} [Thu Jun 16 19:36:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:36:37.529114 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-17661b0a-a814-4950-8e55-a46b3dd93bea admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:36:37.530309 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-17661b0a-a814-4950-8e55-a46b3dd93bea admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001669 Jun 16 19:36:37.530962 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 930 bytes} [Thu Jun 16 19:36:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:36:37.594534 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-ecf6e3df-987b-42d5-ba3a-7b5f296f10fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "rxtx_factor": 1.0, "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:37.698804 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-ecf6e3df-987b-42d5-ba3a-7b5f296f10fe admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.161150 Jun 16 19:36:37.699396 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 18/34] 10.222.0.36 () {64 vars in 1282 bytes} [Thu Jun 16 19:36:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:36:37.711260 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-04c60b91-7187-4685-a590-9f869921f0ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:36:37.788969 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-04c60b91-7187-4685-a590-9f869921f0ea admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081297 Jun 16 19:36:37.789687 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 17/35] 10.222.0.36 () {64 vars in 1332 bytes} [Thu Jun 16 19:36:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:01.858320 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-ecf6e3df-987b-42d5-ba3a-7b5f296f10fe admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:01.859384 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-ecf6e3df-987b-42d5-ba3a-7b5f296f10fe admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 16 19:37:01.859789 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 19/36] 10.222.0.36 () {54 vars in 930 bytes} [Thu Jun 16 19:37:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:37:01.870866 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG dbcounter [-] [110175] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:37:01.918242 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-7b3146ec-bac5-4c15-9d1c-25ac4a98bc47 admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:01.936047 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-7b3146ec-bac5-4c15-9d1c-25ac4a98bc47 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070364 Jun 16 19:37:01.936574 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1291 bytes} [Thu Jun 16 19:37:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:37:02.901942 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-ecf6e3df-987b-42d5-ba3a-7b5f296f10fe admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:02.903003 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-ecf6e3df-987b-42d5-ba3a-7b5f296f10fe admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 16 19:37:02.903407 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Jun 16 19:37:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:37:03.093690 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-5fa0954f-451c-403b-ae4f-ff23f6149b15 admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:03.099146 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.wsgi [None req-5fa0954f-451c-403b-ae4f-ff23f6149b15 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-5fa0954f-451c-403b-ae4f-ff23f6149b15 admin admin] Request method failure captured: Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Accept: application/json Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Accept-Encoding: gzip, deflate Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Connection: keep-alive Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Content-Length: 0 Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Host: 10.222.0.36 Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Openstack-Api-Version: compute 2.90 Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Openstack-System-Scope: None Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: User-Agent: python-novaclient Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Auth-Token: gAAAAABiq4Zef54rzDd-hNJ3ECryPX_26vuVmLThq5FPLx7dDIuUjP5NgG5CAULS-pJiMdEibJfHq7Jn1F_we-kxOwyfE-7r2skxhm5linHUWMGDJjeqShAuqRH-7FFTYOIe3tb7nI5OGfgN0_fX8rsLEB1YM6zTVFaeYEYotmxUxO5gJHCe9EE Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Domain-Id: None Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Domain-Name: None Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Identity-Status: Confirmed Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Is-Admin-Project: True Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Project-Domain-Id: default Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Project-Domain-Name: Default Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Project-Id: adf859e3c6024ed7b109d2f0ca77139a Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Project-Name: admin Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Role: admin,reader,member Jun 16 19:37:03.102972 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Roles: admin,reader,member Jun 16 19:37:03.104746 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/adf859e3c6024ed7b109d2f0ca77139a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/adf859e3c6024ed7b109d2f0ca77139a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_adf859e3c6024ed7b109d2f0ca77139a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/adf859e3c6024ed7b109d2f0ca77139a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:37:03.104746 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Tenant: admin Jun 16 19:37:03.104746 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Tenant-Id: adf859e3c6024ed7b109d2f0ca77139a Jun 16 19:37:03.104746 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Tenant-Name: admin Jun 16 19:37:03.104746 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-User: admin Jun 16 19:37:03.104746 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-User-Domain-Id: default Jun 16 19:37:03.104746 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-User-Domain-Name: Default Jun 16 19:37:03.104746 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-User-Id: 07dde671a0d34c9484dac362c8255554 Jun 16 19:37:03.104746 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-User-Name: admin Jun 16 19:37:03.104746 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: method: > Jun 16 19:37:03.104746 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: exception: Flavor 42 could not be found. Jun 16 19:37:03.104746 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: action_args: {'id': '42'} Jun 16 19:37:03.104746 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:37:03.104746 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:03.105786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 19:37:03.105786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 19:37:03.105786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 19:37:03.105786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 19:37:03.105786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 19:37:03.105786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 19:37:03.105786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 19:37:03.105786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 19:37:03.105786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 19:37:03.105786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:37:03.105786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 19:37:03.105786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 19:37:03.105786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 19:37:03.105786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Jun 16 19:37:03.105786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:37:03.105786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Jun 16 19:37:03.105786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:03.105786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:37:03.105786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:37:03.106982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:37:03.106982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:37:03.106982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:37:03.106982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:37:03.106982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 19:37:03.106982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:37:03.106982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 19:37:03.106982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Jun 16 19:37:03.106982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:37:03.106982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Jun 16 19:37:03.106982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:03.106982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:37:03.106982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:37:03.106982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:37:03.106982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:37:03.106982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 19:37:03.106982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Jun 16 19:37:03.106982 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-5fa0954f-451c-403b-ae4f-ff23f6149b15 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:37:03.108112 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-5fa0954f-451c-403b-ae4f-ff23f6149b15 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061280 Jun 16 19:37:03.108112 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1190 bytes} [Thu Jun 16 19:37:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 19:37:03.113851 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-83242c80-2698-43f5-834d-d201c5dc342d admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:03.116822 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG dbcounter [-] [110174] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:37:03.135110 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-83242c80-2698-43f5-834d-d201c5dc342d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024777 Jun 16 19:37:03.135638 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1210 bytes} [Thu Jun 16 19:37:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:37:03.145002 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-bc63297b-3a24-474d-b78e-5e4447b3495d admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:03.167447 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-bc63297b-3a24-474d-b78e-5e4447b3495d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025685 Jun 16 19:37:03.167769 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1210 bytes} [Thu Jun 16 19:37:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:37:03.177241 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-3b6dc86b-b3d8-4801-bb22-1fa9f01038fe admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:03.183220 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.wsgi [None req-3b6dc86b-b3d8-4801-bb22-1fa9f01038fe admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-3b6dc86b-b3d8-4801-bb22-1fa9f01038fe admin admin] Request method failure captured: Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Accept: application/json Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Accept-Encoding: gzip, deflate Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Connection: keep-alive Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Content-Length: 0 Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Host: 10.222.0.36 Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Openstack-Api-Version: compute 2.90 Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Openstack-System-Scope: None Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: User-Agent: python-novaclient Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Auth-Token: gAAAAABiq4Zef54rzDd-hNJ3ECryPX_26vuVmLThq5FPLx7dDIuUjP5NgG5CAULS-pJiMdEibJfHq7Jn1F_we-kxOwyfE-7r2skxhm5linHUWMGDJjeqShAuqRH-7FFTYOIe3tb7nI5OGfgN0_fX8rsLEB1YM6zTVFaeYEYotmxUxO5gJHCe9EE Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Domain-Id: None Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Domain-Name: None Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Identity-Status: Confirmed Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Is-Admin-Project: True Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Project-Domain-Id: default Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Project-Domain-Name: Default Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Project-Id: adf859e3c6024ed7b109d2f0ca77139a Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Project-Name: admin Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Role: admin,reader,member Jun 16 19:37:03.186420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Roles: admin,reader,member Jun 16 19:37:03.188132 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/adf859e3c6024ed7b109d2f0ca77139a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/adf859e3c6024ed7b109d2f0ca77139a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_adf859e3c6024ed7b109d2f0ca77139a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/adf859e3c6024ed7b109d2f0ca77139a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:37:03.188132 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Tenant: admin Jun 16 19:37:03.188132 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Tenant-Id: adf859e3c6024ed7b109d2f0ca77139a Jun 16 19:37:03.188132 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Tenant-Name: admin Jun 16 19:37:03.188132 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-User: admin Jun 16 19:37:03.188132 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-User-Domain-Id: default Jun 16 19:37:03.188132 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-User-Domain-Name: Default Jun 16 19:37:03.188132 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-User-Id: 07dde671a0d34c9484dac362c8255554 Jun 16 19:37:03.188132 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-User-Name: admin Jun 16 19:37:03.188132 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: method: > Jun 16 19:37:03.188132 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: exception: Flavor 42 could not be found. Jun 16 19:37:03.188132 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: action_args: {'id': '42'} Jun 16 19:37:03.188132 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:37:03.188132 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:03.189077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 19:37:03.189077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 19:37:03.189077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 19:37:03.189077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 19:37:03.189077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 19:37:03.189077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 19:37:03.189077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 19:37:03.189077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 19:37:03.189077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 19:37:03.189077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:37:03.189077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 19:37:03.189077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 19:37:03.189077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 19:37:03.189077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Jun 16 19:37:03.189077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:37:03.189077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Jun 16 19:37:03.189077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:03.189077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:37:03.189077 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:37:03.190169 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:37:03.190169 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:37:03.190169 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:37:03.190169 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:37:03.190169 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 19:37:03.190169 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:37:03.190169 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 19:37:03.190169 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Jun 16 19:37:03.190169 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:37:03.190169 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Jun 16 19:37:03.190169 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:03.190169 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:37:03.190169 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:37:03.190169 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:37:03.190169 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:37:03.190169 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 19:37:03.190169 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Jun 16 19:37:03.190169 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-3b6dc86b-b3d8-4801-bb22-1fa9f01038fe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:37:03.195042 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-3b6dc86b-b3d8-4801-bb22-1fa9f01038fe admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014429 Jun 16 19:37:03.195042 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1190 bytes} [Thu Jun 16 19:37:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 19:37:04.045092 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-bc63297b-3a24-474d-b78e-5e4447b3495d admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:04.046094 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-bc63297b-3a24-474d-b78e-5e4447b3495d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 16 19:37:04.046486 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Jun 16 19:37:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:37:04.235192 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-d0ba4c19-c949-4751-adfb-f69f624c2176 admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:04.240208 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.wsgi [None req-d0ba4c19-c949-4751-adfb-f69f624c2176 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-d0ba4c19-c949-4751-adfb-f69f624c2176 admin admin] Request method failure captured: Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Accept: application/json Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Accept-Encoding: gzip, deflate Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Connection: keep-alive Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Content-Length: 0 Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Host: 10.222.0.36 Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Openstack-Api-Version: compute 2.90 Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Openstack-System-Scope: None Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: User-Agent: python-novaclient Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Auth-Token: gAAAAABiq4ZgtA7gZt6yv8aXgk5IC_xgUK7fCJLkXzsn-2_IAwxl4GlF5QCpJPArt-PgfDAXiXUKe4VsfpcOPjpc1nOXApBqBGKBLlles6WayuzJ5en6g5NEa4J1ipdNW9fj3mPZi9qcNXeg4P9Y9CMzw9EJuT8_8bGw5bWewnQgbPAMUMLhRwI Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Domain-Id: None Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Domain-Name: None Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Identity-Status: Confirmed Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Is-Admin-Project: True Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Project-Domain-Id: default Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Project-Domain-Name: Default Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Project-Id: adf859e3c6024ed7b109d2f0ca77139a Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Project-Name: admin Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Role: admin,reader,member Jun 16 19:37:04.241726 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Roles: admin,reader,member Jun 16 19:37:04.243355 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/adf859e3c6024ed7b109d2f0ca77139a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/adf859e3c6024ed7b109d2f0ca77139a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_adf859e3c6024ed7b109d2f0ca77139a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/adf859e3c6024ed7b109d2f0ca77139a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:37:04.243355 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Tenant: admin Jun 16 19:37:04.243355 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Tenant-Id: adf859e3c6024ed7b109d2f0ca77139a Jun 16 19:37:04.243355 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Tenant-Name: admin Jun 16 19:37:04.243355 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-User: admin Jun 16 19:37:04.243355 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-User-Domain-Id: default Jun 16 19:37:04.243355 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-User-Domain-Name: Default Jun 16 19:37:04.243355 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-User-Id: 07dde671a0d34c9484dac362c8255554 Jun 16 19:37:04.243355 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-User-Name: admin Jun 16 19:37:04.243355 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: method: > Jun 16 19:37:04.243355 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: exception: Flavor 84 could not be found. Jun 16 19:37:04.243355 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: action_args: {'id': '84'} Jun 16 19:37:04.243355 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:37:04.243355 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:04.244329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 19:37:04.244329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 19:37:04.244329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 19:37:04.244329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 19:37:04.244329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 19:37:04.244329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 19:37:04.244329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 19:37:04.244329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 19:37:04.244329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 19:37:04.244329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:37:04.244329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 19:37:04.244329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 19:37:04.244329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 19:37:04.244329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Jun 16 19:37:04.244329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:37:04.244329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Jun 16 19:37:04.244329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:04.244329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:37:04.244329 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:37:04.245848 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:37:04.245848 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:37:04.245848 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:37:04.245848 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:37:04.245848 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 19:37:04.245848 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:37:04.245848 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 19:37:04.245848 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Jun 16 19:37:04.245848 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:37:04.245848 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Jun 16 19:37:04.245848 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:04.245848 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:37:04.245848 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:37:04.245848 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:37:04.245848 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:37:04.245848 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 19:37:04.245848 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Jun 16 19:37:04.245848 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-d0ba4c19-c949-4751-adfb-f69f624c2176 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:37:04.247217 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-d0ba4c19-c949-4751-adfb-f69f624c2176 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059656 Jun 16 19:37:04.247217 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1190 bytes} [Thu Jun 16 19:37:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 19:37:04.252929 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-e48847bd-7285-4f67-ab2c-239ba40aa2e0 admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:04.268531 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-e48847bd-7285-4f67-ab2c-239ba40aa2e0 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019222 Jun 16 19:37:04.269003 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1210 bytes} [Thu Jun 16 19:37:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:37:04.279155 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-bffbc59a-17ff-4fb0-bf7c-75cc5f7b7462 admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:04.292921 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-bffbc59a-17ff-4fb0-bf7c-75cc5f7b7462 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017590 Jun 16 19:37:04.293439 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1210 bytes} [Thu Jun 16 19:37:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:37:04.302709 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-cb61eed1-4fa5-4488-88c1-b45bed16a4bf admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:04.308291 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.wsgi [None req-cb61eed1-4fa5-4488-88c1-b45bed16a4bf admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-cb61eed1-4fa5-4488-88c1-b45bed16a4bf admin admin] Request method failure captured: Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Accept: application/json Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Accept-Encoding: gzip, deflate Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Connection: keep-alive Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Content-Length: 0 Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Host: 10.222.0.36 Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Openstack-Api-Version: compute 2.90 Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Openstack-System-Scope: None Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: User-Agent: python-novaclient Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Auth-Token: gAAAAABiq4ZgtA7gZt6yv8aXgk5IC_xgUK7fCJLkXzsn-2_IAwxl4GlF5QCpJPArt-PgfDAXiXUKe4VsfpcOPjpc1nOXApBqBGKBLlles6WayuzJ5en6g5NEa4J1ipdNW9fj3mPZi9qcNXeg4P9Y9CMzw9EJuT8_8bGw5bWewnQgbPAMUMLhRwI Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Domain-Id: None Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Domain-Name: None Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Identity-Status: Confirmed Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Is-Admin-Project: True Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Project-Domain-Id: default Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Project-Domain-Name: Default Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Project-Id: adf859e3c6024ed7b109d2f0ca77139a Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Project-Name: admin Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Role: admin,reader,member Jun 16 19:37:04.309786 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Roles: admin,reader,member Jun 16 19:37:04.311388 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/adf859e3c6024ed7b109d2f0ca77139a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/adf859e3c6024ed7b109d2f0ca77139a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_adf859e3c6024ed7b109d2f0ca77139a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/adf859e3c6024ed7b109d2f0ca77139a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:37:04.311388 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Tenant: admin Jun 16 19:37:04.311388 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Tenant-Id: adf859e3c6024ed7b109d2f0ca77139a Jun 16 19:37:04.311388 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Tenant-Name: admin Jun 16 19:37:04.311388 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-User: admin Jun 16 19:37:04.311388 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-User-Domain-Id: default Jun 16 19:37:04.311388 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-User-Domain-Name: Default Jun 16 19:37:04.311388 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-User-Id: 07dde671a0d34c9484dac362c8255554 Jun 16 19:37:04.311388 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-User-Name: admin Jun 16 19:37:04.311388 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: method: > Jun 16 19:37:04.311388 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: exception: Flavor 84 could not be found. Jun 16 19:37:04.311388 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: action_args: {'id': '84'} Jun 16 19:37:04.311388 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:37:04.311388 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:04.312428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 19:37:04.312428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 19:37:04.312428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 19:37:04.312428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 19:37:04.312428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 19:37:04.312428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 19:37:04.312428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 19:37:04.312428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 19:37:04.312428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 19:37:04.312428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:37:04.312428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 19:37:04.312428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 19:37:04.312428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 19:37:04.312428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Jun 16 19:37:04.312428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:37:04.312428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Jun 16 19:37:04.312428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:04.312428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:37:04.312428 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:37:04.313758 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:37:04.313758 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:37:04.313758 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:37:04.313758 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:37:04.313758 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 19:37:04.313758 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:37:04.313758 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 19:37:04.313758 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Jun 16 19:37:04.313758 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:37:04.313758 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Jun 16 19:37:04.313758 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:04.313758 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:37:04.313758 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:37:04.313758 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:37:04.313758 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:37:04.313758 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 19:37:04.313758 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Jun 16 19:37:04.313758 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-cb61eed1-4fa5-4488-88c1-b45bed16a4bf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:37:04.315025 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-cb61eed1-4fa5-4488-88c1-b45bed16a4bf admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012039 Jun 16 19:37:04.315025 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 23/47] 10.222.0.36 () {60 vars in 1190 bytes} [Thu Jun 16 19:37:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 19:37:05.169941 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-bffbc59a-17ff-4fb0-bf7c-75cc5f7b7462 admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:05.170964 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-bffbc59a-17ff-4fb0-bf7c-75cc5f7b7462 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 16 19:37:05.171364 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Jun 16 19:37:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:37:05.360342 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-38beff17-9be0-4d1c-84df-a966e892504e admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:05.365615 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.wsgi [None req-38beff17-9be0-4d1c-84df-a966e892504e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-38beff17-9be0-4d1c-84df-a966e892504e admin admin] Request method failure captured: Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Accept: application/json Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Accept-Encoding: gzip, deflate Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Connection: keep-alive Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Content-Length: 0 Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Host: 10.222.0.36 Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Openstack-Api-Version: compute 2.90 Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Openstack-System-Scope: None Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: User-Agent: python-novaclient Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Auth-Token: gAAAAABiq4ZhA8_UQBHk6WU2sowPgORzCiWQKEaH5pY_f-jL_gv6v1Sxa5GNshKBq3Ddtz1yHeiRz_ufyCoDI1LO6JnDi1l3agJLFeYAaD4nDF68b5Igp5_EWvUIqkS1BFYGi78nP8iStcMw6-3oyjS_uw83cTra2jfMtdHXjrUZr2ThelNE9ok Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Domain-Id: None Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Domain-Name: None Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Identity-Status: Confirmed Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Is-Admin-Project: True Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Project-Domain-Id: default Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Project-Domain-Name: Default Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Project-Id: adf859e3c6024ed7b109d2f0ca77139a Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Project-Name: admin Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Role: admin,reader,member Jun 16 19:37:05.367193 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Roles: admin,reader,member Jun 16 19:37:05.368769 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/adf859e3c6024ed7b109d2f0ca77139a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/adf859e3c6024ed7b109d2f0ca77139a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_adf859e3c6024ed7b109d2f0ca77139a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/adf859e3c6024ed7b109d2f0ca77139a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:37:05.368769 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Tenant: admin Jun 16 19:37:05.368769 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Tenant-Id: adf859e3c6024ed7b109d2f0ca77139a Jun 16 19:37:05.368769 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-Tenant-Name: admin Jun 16 19:37:05.368769 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-User: admin Jun 16 19:37:05.368769 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-User-Domain-Id: default Jun 16 19:37:05.368769 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-User-Domain-Name: Default Jun 16 19:37:05.368769 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-User-Id: 07dde671a0d34c9484dac362c8255554 Jun 16 19:37:05.368769 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: X-User-Name: admin Jun 16 19:37:05.368769 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: method: > Jun 16 19:37:05.368769 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: exception: Flavor 451 could not be found. Jun 16 19:37:05.368769 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: action_args: {'id': '451'} Jun 16 19:37:05.368769 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:37:05.368769 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:05.369767 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 19:37:05.369767 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 19:37:05.369767 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 19:37:05.369767 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 19:37:05.369767 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 19:37:05.369767 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 19:37:05.369767 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 19:37:05.369767 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 19:37:05.369767 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 19:37:05.369767 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:37:05.369767 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 19:37:05.369767 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 19:37:05.369767 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 19:37:05.369767 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Jun 16 19:37:05.369767 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:37:05.369767 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Jun 16 19:37:05.369767 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:05.369767 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:37:05.369767 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:37:05.371284 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:37:05.371284 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:37:05.371284 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:37:05.371284 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:37:05.371284 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 19:37:05.371284 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:37:05.371284 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 19:37:05.371284 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Jun 16 19:37:05.371284 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:37:05.371284 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Jun 16 19:37:05.371284 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:05.371284 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:37:05.371284 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:37:05.371284 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:37:05.371284 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:37:05.371284 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 19:37:05.371284 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: ERROR nova.api.openstack.wsgi Jun 16 19:37:05.371284 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-38beff17-9be0-4d1c-84df-a966e892504e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:37:05.372715 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-38beff17-9be0-4d1c-84df-a966e892504e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059193 Jun 16 19:37:05.372715 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1193 bytes} [Thu Jun 16 19:37:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 19:37:05.377994 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-d1dc0d5e-1a31-45bb-9ed4-8cc244c7eb85 admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:05.391556 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-d1dc0d5e-1a31-45bb-9ed4-8cc244c7eb85 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017067 Jun 16 19:37:05.392029 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1210 bytes} [Thu Jun 16 19:37:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:37:05.402731 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-3d37b6f8-278a-4adf-bdb4-654a586a1102 admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:05.416253 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-3d37b6f8-278a-4adf-bdb4-654a586a1102 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017806 Jun 16 19:37:05.416808 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 25/51] 10.222.0.36 () {60 vars in 1210 bytes} [Thu Jun 16 19:37:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:37:05.425632 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-842c3038-ac9e-425a-9ad9-2ad13a49f9a2 admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:05.430798 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.wsgi [None req-842c3038-ac9e-425a-9ad9-2ad13a49f9a2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-842c3038-ac9e-425a-9ad9-2ad13a49f9a2 admin admin] Request method failure captured: Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Accept: application/json Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Accept-Encoding: gzip, deflate Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Connection: keep-alive Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Content-Length: 0 Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Host: 10.222.0.36 Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Openstack-Api-Version: compute 2.90 Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Openstack-System-Scope: None Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: User-Agent: python-novaclient Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Auth-Token: gAAAAABiq4ZhA8_UQBHk6WU2sowPgORzCiWQKEaH5pY_f-jL_gv6v1Sxa5GNshKBq3Ddtz1yHeiRz_ufyCoDI1LO6JnDi1l3agJLFeYAaD4nDF68b5Igp5_EWvUIqkS1BFYGi78nP8iStcMw6-3oyjS_uw83cTra2jfMtdHXjrUZr2ThelNE9ok Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Domain-Id: None Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Domain-Name: None Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Identity-Status: Confirmed Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Is-Admin-Project: True Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Project-Domain-Id: default Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Project-Domain-Name: Default Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Project-Id: adf859e3c6024ed7b109d2f0ca77139a Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Project-Name: admin Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Role: admin,reader,member Jun 16 19:37:05.432317 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Roles: admin,reader,member Jun 16 19:37:05.434257 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/adf859e3c6024ed7b109d2f0ca77139a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/adf859e3c6024ed7b109d2f0ca77139a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_adf859e3c6024ed7b109d2f0ca77139a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/adf859e3c6024ed7b109d2f0ca77139a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:37:05.434257 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Tenant: admin Jun 16 19:37:05.434257 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Tenant-Id: adf859e3c6024ed7b109d2f0ca77139a Jun 16 19:37:05.434257 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-Tenant-Name: admin Jun 16 19:37:05.434257 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-User: admin Jun 16 19:37:05.434257 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-User-Domain-Id: default Jun 16 19:37:05.434257 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-User-Domain-Name: Default Jun 16 19:37:05.434257 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-User-Id: 07dde671a0d34c9484dac362c8255554 Jun 16 19:37:05.434257 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: X-User-Name: admin Jun 16 19:37:05.434257 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: method: > Jun 16 19:37:05.434257 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: exception: Flavor 451 could not be found. Jun 16 19:37:05.434257 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: action_args: {'id': '451'} Jun 16 19:37:05.434257 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:37:05.434257 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:05.435227 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 19:37:05.435227 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 19:37:05.435227 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 19:37:05.435227 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 19:37:05.435227 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 19:37:05.435227 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 19:37:05.435227 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 19:37:05.435227 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 19:37:05.435227 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 19:37:05.435227 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:37:05.435227 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 19:37:05.435227 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 19:37:05.435227 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 19:37:05.435227 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Jun 16 19:37:05.435227 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:37:05.435227 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Jun 16 19:37:05.435227 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:05.435227 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:37:05.435227 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:37:05.436515 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:37:05.436515 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:37:05.436515 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:37:05.436515 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:37:05.436515 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 19:37:05.436515 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:37:05.436515 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 19:37:05.436515 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Jun 16 19:37:05.436515 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:37:05.436515 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Jun 16 19:37:05.436515 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:37:05.436515 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:37:05.436515 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:37:05.436515 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:37:05.436515 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:37:05.436515 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 19:37:05.436515 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: ERROR nova.api.openstack.wsgi Jun 16 19:37:05.436515 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-842c3038-ac9e-425a-9ad9-2ad13a49f9a2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:37:05.437785 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-842c3038-ac9e-425a-9ad9-2ad13a49f9a2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011851 Jun 16 19:37:05.437785 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 27/52] 10.222.0.36 () {60 vars in 1193 bytes} [Thu Jun 16 19:37:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 19:37:06.301719 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-3d37b6f8-278a-4adf-bdb4-654a586a1102 admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:06.302725 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-3d37b6f8-278a-4adf-bdb4-654a586a1102 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 16 19:37:06.303151 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Jun 16 19:37:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:37:06.494323 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-74aad503-90eb-4a8a-9a51-6e276041fd73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:37:06.576646 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-74aad503-90eb-4a8a-9a51-6e276041fd73 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.133540 Jun 16 19:37:06.577193 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 28/54] 10.222.0.36 () {64 vars in 1235 bytes} [Thu Jun 16 19:37:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:37:07.431515 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-3d37b6f8-278a-4adf-bdb4-654a586a1102 admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:07.432552 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-3d37b6f8-278a-4adf-bdb4-654a586a1102 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 16 19:37:07.433233 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Jun 16 19:37:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:37:07.622462 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-37825b3a-6c3b-45d4-a9f2-2ba80785efee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:37:07.732642 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-37825b3a-6c3b-45d4-a9f2-2ba80785efee admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.159805 Jun 16 19:37:07.733373 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 29/56] 10.222.0.36 () {64 vars in 1235 bytes} [Thu Jun 16 19:37:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:37:08.597102 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-3d37b6f8-278a-4adf-bdb4-654a586a1102 admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:08.598137 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-3d37b6f8-278a-4adf-bdb4-654a586a1102 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jun 16 19:37:08.598529 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Jun 16 19:37:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:37:08.804094 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-058d9a95-f30b-47ff-9fc9-46df09a10e8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:37:08.881192 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-058d9a95-f30b-47ff-9fc9-46df09a10e8a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.140500 Jun 16 19:37:08.881674 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 30/58] 10.222.0.36 () {64 vars in 1235 bytes} [Thu Jun 16 19:37:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:37:09.755124 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-3d37b6f8-278a-4adf-bdb4-654a586a1102 admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:09.756136 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-3d37b6f8-278a-4adf-bdb4-654a586a1102 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 16 19:37:09.756532 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Jun 16 19:37:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:37:09.945677 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-fd9678ea-9354-448a-b972-f752e55cf118 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:37:10.024472 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-fd9678ea-9354-448a-b972-f752e55cf118 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.129511 Jun 16 19:37:10.025004 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 31/60] 10.222.0.36 () {64 vars in 1235 bytes} [Thu Jun 16 19:37:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:37:10.887421 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-3d37b6f8-278a-4adf-bdb4-654a586a1102 admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:10.888434 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-3d37b6f8-278a-4adf-bdb4-654a586a1102 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 16 19:37:10.888827 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Jun 16 19:37:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:37:11.078363 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-5c746b83-cc93-40c1-80a6-0a3c01388569 admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:11.097339 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-5c746b83-cc93-40c1-80a6-0a3c01388569 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070624 Jun 16 19:37:11.097813 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 32/62] 10.222.0.36 () {60 vars in 1202 bytes} [Thu Jun 16 19:37:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:37:59.357022 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-3d37b6f8-278a-4adf-bdb4-654a586a1102 admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:59.358029 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-3d37b6f8-278a-4adf-bdb4-654a586a1102 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 16 19:37:59.358420 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 930 bytes} [Thu Jun 16 19:37:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:37:59.369236 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG dbcounter [-] [110174] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:37:59.417233 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-63ef3f5f-0b79-44a2-b587-a5ab974aebf4 admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:59.435651 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-63ef3f5f-0b79-44a2-b587-a5ab974aebf4 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071159 Jun 16 19:37:59.436180 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1291 bytes} [Thu Jun 16 19:37:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:37:59.458528 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-20b754e3-83f1-40a5-bc79-88aff385aab7 admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:59.461962 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG dbcounter [-] [110175] Writing DB stats nova_api:SELECT=14 {{(pid=110175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:37:59.467437 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-20b754e3-83f1-40a5-bc79-88aff385aab7 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012494 Jun 16 19:37:59.476494 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 32/65] 10.222.0.36 () {60 vars in 1282 bytes} [Thu Jun 16 19:37:59 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:59.479846 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-390292fc-822c-45b3-84a7-7624e922afb0 admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:59.487546 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-390292fc-822c-45b3-84a7-7624e922afb0 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011973 Jun 16 19:37:59.488058 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 34/66] 10.222.0.36 () {60 vars in 1285 bytes} [Thu Jun 16 19:37:59 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:59.499342 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-5cb89003-4653-42a8-9cde-8048e172cf43 admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:59.506558 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-5cb89003-4653-42a8-9cde-8048e172cf43 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011020 Jun 16 19:37:59.507103 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1285 bytes} [Thu Jun 16 19:37:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:37:59.518290 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-70ceb3ea-5309-4296-9d67-757ad0dae79a admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:37:59.526290 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-70ceb3ea-5309-4296-9d67-757ad0dae79a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011710 Jun 16 19:37:59.526802 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 35/68] 10.222.0.36 () {60 vars in 1282 bytes} [Thu Jun 16 19:37:59 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:41:29.070581 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-5cb89003-4653-42a8-9cde-8048e172cf43 admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:29.071650 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-5cb89003-4653-42a8-9cde-8048e172cf43 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 16 19:41:29.072042 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 34/69] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Jun 16 19:41:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:41:29.228773 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG dbcounter [-] [110174] Writing DB stats nova_api:SELECT=6 {{(pid=110174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:41:29.341904 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-46a05502-dfec-4147-a2e5-b853e762c1ef admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:29.343146 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:41:29.343146 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: warnings.warn(msg) Jun 16 19:41:29.344344 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-46a05502-dfec-4147-a2e5-b853e762c1ef admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:29.344777 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-46a05502-dfec-4147-a2e5-b853e762c1ef admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:29.345543 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-46a05502-dfec-4147-a2e5-b853e762c1ef admin admin] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:29.345963 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-46a05502-dfec-4147-a2e5-b853e762c1ef admin admin] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:29.379340 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-46a05502-dfec-4147-a2e5-b853e762c1ef admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152218 Jun 16 19:41:29.379906 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 36/70] 10.222.0.36 () {60 vars in 1193 bytes} [Thu Jun 16 19:41:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:41:30.241525 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-5cb89003-4653-42a8-9cde-8048e172cf43 admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:30.242533 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-5cb89003-4653-42a8-9cde-8048e172cf43 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 16 19:41:30.242946 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 35/71] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Jun 16 19:41:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:41:30.438510 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-573bd157-e0b4-4d1d-89f9-9852b9d656ce admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:30.439720 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:41:30.439720 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: warnings.warn(msg) Jun 16 19:41:30.440930 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-573bd157-e0b4-4d1d-89f9-9852b9d656ce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:30.441367 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-573bd157-e0b4-4d1d-89f9-9852b9d656ce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:30.442161 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-573bd157-e0b4-4d1d-89f9-9852b9d656ce admin admin] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:30.442588 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-573bd157-e0b4-4d1d-89f9-9852b9d656ce admin admin] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:30.462420 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-573bd157-e0b4-4d1d-89f9-9852b9d656ce admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080117 Jun 16 19:41:30.462973 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 37/72] 10.222.0.36 () {60 vars in 1193 bytes} [Thu Jun 16 19:41:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:41:41.740810 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-5cb89003-4653-42a8-9cde-8048e172cf43 admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:41.741822 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-5cb89003-4653-42a8-9cde-8048e172cf43 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 16 19:41:41.742218 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 36/73] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Jun 16 19:41:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:41:41.885945 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG dbcounter [-] [110174] Writing DB stats nova_cell0:SELECT=4 {{(pid=110174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:41:41.886566 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG dbcounter [-] [110174] Writing DB stats nova_cell1:SELECT=4 {{(pid=110174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:41:41.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG dbcounter [-] [110174] Writing DB stats nova_api:SELECT=8 {{(pid=110174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:41:41.935397 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-64306bde-aac2-49a5-b554-185ab25c87e6 admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:41.936002 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:41:41.936002 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: warnings.warn(msg) Jun 16 19:41:41.937267 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-64306bde-aac2-49a5-b554-185ab25c87e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:41.937701 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-64306bde-aac2-49a5-b554-185ab25c87e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:41.938471 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-64306bde-aac2-49a5-b554-185ab25c87e6 admin admin] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:41.939105 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-64306bde-aac2-49a5-b554-185ab25c87e6 admin admin] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:41.964934 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-64306bde-aac2-49a5-b554-185ab25c87e6 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083488 Jun 16 19:41:41.965477 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 38/74] 10.222.0.36 () {60 vars in 1193 bytes} [Thu Jun 16 19:41:41 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:41:42.834052 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: DEBUG nova.api.openstack.wsgi [None req-5cb89003-4653-42a8-9cde-8048e172cf43 admin admin] Calling method '>' {{(pid=110175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:42.835097 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: INFO nova.api.openstack.requestlog [None req-5cb89003-4653-42a8-9cde-8048e172cf43 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 16 19:41:42.835506 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: [pid: 110175|app: 0|req: 37/75] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Jun 16 19:41:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:41:43.027141 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG nova.api.openstack.wsgi [None req-eb288f8f-87a6-4a96-a2af-7067eb467499 admin admin] Calling method '>' {{(pid=110174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:41:43.028298 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 19:41:43.028298 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: warnings.warn(msg) Jun 16 19:41:43.029533 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-eb288f8f-87a6-4a96-a2af-7067eb467499 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:43.029966 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-eb288f8f-87a6-4a96-a2af-7067eb467499 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:43.030740 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-eb288f8f-87a6-4a96-a2af-7067eb467499 admin admin] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:41:43.031188 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: DEBUG oslo_concurrency.lockutils [None req-eb288f8f-87a6-4a96-a2af-7067eb467499 admin admin] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:41:43.052651 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: INFO nova.api.openstack.requestlog [None req-eb288f8f-87a6-4a96-a2af-7067eb467499 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077253 Jun 16 19:41:43.053127 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: [pid: 110174|app: 0|req: 39/76] 10.222.0.36 () {60 vars in 1193 bytes} [Thu Jun 16 19:41:42 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:42:42.758492 dv-cinder-846173-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 19:42:42.759049 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: Thu Jun 16 19:42:42 2022 - graceful shutdown triggered... Jun 16 19:42:42.759498 dv-cinder-846173-1-iscsi devstack@n-api.service[110174]: Gracefully killing worker 1 (pid: 110174)... Jun 16 19:42:42.759931 dv-cinder-846173-1-iscsi devstack@n-api.service[110175]: Gracefully killing worker 2 (pid: 110175)... Jun 16 19:42:43.759906 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: worker 1 buried after 1 seconds Jun 16 19:42:43.760423 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: worker 2 buried after 1 seconds Jun 16 19:42:43.760423 dv-cinder-846173-1-iscsi devstack@n-api.service[110173]: goodbye to uWSGI. Jun 16 19:42:43.761561 dv-cinder-846173-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 19:42:43.762107 dv-cinder-846173-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 19:42:43.765445 dv-cinder-846173-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 19:42:43.775768 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 19:42:43.777776 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 19:42:43 2022] *** Jun 16 19:42:43.777776 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 19:42:43.777776 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 19:42:43.777776 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: nodename: dv-cinder-846173-1-iscsi Jun 16 19:42:43.777776 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: machine: x86_64 Jun 16 19:42:43.777776 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: clock source: unix Jun 16 19:42:43.777776 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: pcre jit disabled Jun 16 19:42:43.777776 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: detected number of CPU cores: 4 Jun 16 19:42:43.777776 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: current working directory: / Jun 16 19:42:43.777776 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: detected binary path: /usr/bin/uwsgi-core Jun 16 19:42:43.777776 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: your processes number limit is 47680 Jun 16 19:42:43.777776 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: your memory page size is 4096 bytes Jun 16 19:42:43.777776 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: detected max file descriptor number: 2048 Jun 16 19:42:43.778834 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: lock engine: pthread robust mutexes Jun 16 19:42:43.778834 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: thunder lock: enabled Jun 16 19:42:43.778834 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 19:42:43.778834 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 19:42:43.822663 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: Python main interpreter initialized at 0x55e5913429c0 Jun 16 19:42:43.822663 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: python threads support enabled Jun 16 19:42:43.822663 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: your server socket listen backlog is limited to 100 connections Jun 16 19:42:43.822663 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: your mercy for graceful operations on workers is 90 seconds Jun 16 19:42:43.823106 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 19:42:43.823106 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: *** Operational MODE: preforking *** Jun 16 19:42:43.823322 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: *** uWSGI is running in multiple interpreter mode *** Jun 16 19:42:43.823322 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: spawned uWSGI master process (pid: 124532) Jun 16 19:42:43.823527 dv-cinder-846173-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 19:42:43.824097 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: spawned uWSGI worker 1 (pid: 124550, cores: 1) Jun 16 19:42:43.824602 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: spawned uWSGI worker 2 (pid: 124551, cores: 1) Jun 16 19:42:43.824893 dv-cinder-846173-1-iscsi devstack@n-api.service[124532]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 19:42:44.483725 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 19:42:44.484330 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 19:42:45.742880 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 19:42:45.742880 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: from cryptography.utils import int_from_bytes Jun 16 19:42:45.743531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 19:42:45.743531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: from cryptography.utils import int_from_bytes Jun 16 19:42:45.743531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 19:42:45.743531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: from cryptography.utils import int_from_bytes Jun 16 19:42:45.744059 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 19:42:45.744059 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: from cryptography.utils import int_from_bytes Jun 16 19:42:48.141785 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 19:42:48.142445 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 19:42:48.142543 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 19:42:48.142973 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 19:42:48.143358 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 19:42:48.143797 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.144132 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.144473 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.144800 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.145181 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.145497 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.145821 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.146147 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.146481 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.146748 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.147101 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.147433 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846173-1-iscsi {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.147759 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.148069 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.148385 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.148708 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.149016 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.149348 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.149656 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.150158 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.150609 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.150951 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.151260 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.151603 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.151923 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.152240 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.152566 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.152880 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.153734 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.154048 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.154463 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846173-1-iscsi {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.154780 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.155117 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.155436 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.155852 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.156168 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.156484 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.156811 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.157136 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.157450 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.157799 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.158121 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.158447 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.158772 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.158903 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 19:42:48.159344 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.159446 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 19:42:48.159533 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.159691 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 19:42:48.159786 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.160016 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.160125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 19:42:48.160293 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 19:42:48.160392 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.160621 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.160722 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.160880 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.160988 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.161186 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.161294 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.161513 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.161612 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.161838 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.161952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.162167 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.162284 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.162443 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.162549 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.162706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.162811 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.163007 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.163182 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.163343 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.163452 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.163662 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.163780 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.163960 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.164062 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846173-1-iscsi {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.164273 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.164391 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.164585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.164695 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.164909 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.165021 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.165209 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.165324 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.165520 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.165621 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.165831 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.165941 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.166134 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.166347 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.167105 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.167264 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.167436 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.167594 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.167747 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.167923 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.168069 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.168213 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.168366 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.168544 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.169322 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.169474 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.169625 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.169777 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.169932 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.170089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.170089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.170377 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.170532 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.170686 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.170838 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.171024 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.171024 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.171342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846173-1-iscsi {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.171495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.171653 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.171995 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.172161 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.172315 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.172467 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.172626 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.172786 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.172948 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.173103 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.173255 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.173419 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.174608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.174873 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.175064 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.175225 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.175380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.175524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.175684 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.175916 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.176147 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.176311 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.176457 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.176623 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.176779 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.176924 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.177067 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.177211 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.177356 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.177507 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.177669 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.177821 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.177965 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.178119 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.178264 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.178447 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.178615 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.178769 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.178769 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.179072 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.179230 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.179375 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.179530 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.179675 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.179828 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.179971 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.180115 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.180278 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.180437 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.180583 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.180728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.180888 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.181034 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.181192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.181338 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.181494 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.181648 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.181809 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.182202 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.182356 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.182515 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.182671 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.182817 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.182991 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.183143 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.183287 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.183443 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.183605 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.183758 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.183902 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.184055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.184198 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.184342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.184515 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.184662 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.184830 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.185049 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.185206 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.185360 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.185517 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.185664 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.185814 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.185967 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.186130 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.186354 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.186513 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.186684 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.186830 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.186999 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.187151 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.187314 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.187460 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.187613 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.187769 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.187915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.188058 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.188216 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.188369 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.188524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.188675 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.188822 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.188965 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.189118 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.189263 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.189415 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.189566 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.189719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.189871 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.190025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.190169 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.190313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.190474 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.190619 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.190775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.190939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.191091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.191246 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.191390 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.191533 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.191694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.191846 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.191991 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.192364 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.192364 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.192674 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.192831 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.192985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.193131 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.193280 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.193439 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.193584 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.193737 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.193890 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.194043 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.194187 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.194338 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.194742 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.194909 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.195227 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.195377 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.195522 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.195677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.195836 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.195988 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.196140 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.196291 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.196528 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.196679 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.196833 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.196989 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.197132 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.197277 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.197429 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.197592 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.197738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.197882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.198032 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.198241 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.198392 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.198537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.198537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.198826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.199020 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.199180 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.199333 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.199478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.199629 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.199774 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.199938 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.200091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.200463 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.200620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.200765 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.200920 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.201075 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.201239 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.201386 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.201536 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.201689 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.201834 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.201992 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.202136 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.202553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.202553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.202851 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.203037 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.203185 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.203337 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.203501 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.203647 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.203799 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.203953 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.204182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.204344 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.204498 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.204644 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.204788 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.204950 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.205105 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.205335 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.205504 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.205660 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.205812 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.205965 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.206119 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.206271 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.206464 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.206707 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 19:42:48.206858 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.207072 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.207239 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.207385 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.207537 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.207694 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.207846 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.207999 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.208153 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.208340 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.208499 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.208646 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.208791 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.208945 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.209091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.209242 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.209387 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.209539 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.209694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.209854 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.210000 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.210144 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.210286 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.210430 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.210582 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.210745 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.210890 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.211061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.211207 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.211351 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.211517 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.211675 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.211829 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.211974 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.212162 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.212310 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.212698 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.212861 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.213017 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.213162 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.213307 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.213451 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.213608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.213765 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.213909 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.214061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.214214 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.214379 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.214534 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.214686 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.214846 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.215026 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.215176 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.215346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.216068 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.216222 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.216386 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.216532 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.216695 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.216919 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.217069 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.217223 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.217368 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.217521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.218240 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.218413 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.218570 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.218725 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.218882 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.219077 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.219236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.219393 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.219547 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.219699 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.219844 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.219989 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.220140 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.220295 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.220441 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.220586 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.220776 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.220947 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.221104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.221336 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.221497 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.221644 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.221824 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.221985 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.222145 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.222298 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.222452 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.222832 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.223035 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.223194 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.223361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.223509 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.223654 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.223806 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.224004 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.224164 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.224320 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.224467 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.224611 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.224755 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.224927 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.225083 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.225237 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.225393 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.225538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.225682 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.225827 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.225986 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.226225 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.226384 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.226538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.226692 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.226838 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.227159 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.227310 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.227471 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.227618 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.227772 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.227917 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.228079 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.228224 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.228368 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.228368 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.228642 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.228815 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.229448 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.229612 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.229760 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.229917 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.230069 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.230230 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.230383 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.230529 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.230671 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.230825 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.231019 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.231807 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.231961 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.232123 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.232269 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.232431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.232595 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.232858 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.233083 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.233241 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.233395 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.233640 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.233792 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.233954 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.234100 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.234244 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.234396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.234558 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.234784 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.235012 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.235176 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.235323 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.235468 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.235622 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.235781 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.235933 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.236080 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.236249 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.236465 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.236622 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.236782 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.236928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.237101 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.237322 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.237514 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.237672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.237832 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.237978 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.238131 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.238275 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.238419 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.238576 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.238728 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.238889 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.239080 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.239238 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.239382 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.239536 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.239681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.239826 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.239977 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.240132 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.240279 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.240437 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.240582 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.240726 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.240878 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.241040 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.241192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.241349 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.241494 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.241646 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.241646 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.241928 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.241928 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.242219 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.242219 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.242501 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.242501 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.242815 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.243089 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.243312 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.243463 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.243633 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.243872 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.244030 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.244185 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.244331 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.244520 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.244670 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.244824 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.244985 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.245144 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.245310 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.245482 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.245640 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.245785 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.245940 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.246084 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.246237 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.246391 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.246619 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.247447 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.247618 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.247767 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.247911 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.248066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.248210 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.248361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.248515 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.248662 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.248806 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.248957 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.249110 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.249266 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.249425 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.249570 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.249723 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.249886 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.250032 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.250183 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.250342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.250494 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.250639 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.250784 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.250954 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.251124 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.251280 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.251433 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.251578 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.251732 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.251894 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.252054 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.252199 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.252343 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.252487 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.252630 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.252775 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.252934 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.253096 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.253334 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.253560 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.253717 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.253883 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.254133 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.254292 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.254446 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.254592 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.254735 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.254889 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.255101 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.255249 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.255395 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.255540 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.255692 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.255852 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.256005 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.256171 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.256325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.256470 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.256642 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.256876 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.257033 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.257179 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.257324 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.257492 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.257718 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.257887 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.258223 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.258404 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.258556 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.258706 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.258870 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.259047 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.259047 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.259348 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.259507 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.259658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.259824 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.259982 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.260141 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.260293 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.260456 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.260622 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.260789 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.260941 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.261092 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.261242 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.261401 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.261551 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.261716 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.261868 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.262018 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.262189 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.262384 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.263058 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.263209 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.263438 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.263686 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.263853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.264000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.264161 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.264395 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.264545 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.264698 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.264926 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.265084 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.265236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.265402 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.265548 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.265707 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.265852 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.266018 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.266174 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.266327 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.266480 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.266635 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.266781 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.267069 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.267223 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.267379 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.267537 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.267715 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.267931 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.268081 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.268234 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.268395 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.268549 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.268705 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.268858 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.269014 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.269160 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.269305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.269478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.269675 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.269837 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.269983 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.269983 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.270273 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.270429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.270582 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.270734 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.270885 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.271086 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.271242 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.271401 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.271563 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.271719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.271870 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.272022 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.272181 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.272334 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.272478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.272630 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.272774 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.272918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.273080 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.273233 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.273384 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.273666 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.273904 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.273904 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.274228 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.274398 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.274646 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.274805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.274991 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.275150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.275315 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.275467 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.275625 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.275788 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.275940 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.276100 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.276253 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.276409 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.276559 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.276716 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.276876 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.277059 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.277290 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.277450 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.277601 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.277762 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.277971 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.278194 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.278350 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.278513 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.278665 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.278824 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.279557 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.279723 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.279876 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.280027 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.280196 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.280354 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.280507 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.280670 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.280820 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.280969 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.281135 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.281287 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.281444 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.281595 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.281746 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.281896 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.282060 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.282213 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.282371 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.282521 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.282693 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.282851 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.283080 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.283236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.283394 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.283545 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.283788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.284050 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.284211 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.284363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.284520 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.284689 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.284940 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.285124 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.285286 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.285445 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.285605 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.285756 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.285906 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.286066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.286237 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.286509 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.286683 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.286838 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.287030 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.287205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.287445 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.287603 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.287772 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.287924 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.288085 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.288327 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.288488 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.288656 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.288808 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.288966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.289139 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.289291 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.289468 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.289621 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.289772 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.289922 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.290123 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.290283 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.290434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.290587 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.290738 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.290897 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.291073 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.291225 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.291388 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.291559 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.291711 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.291876 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.291876 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.292179 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.292179 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.292473 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.292625 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.292785 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.292945 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.293096 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.293254 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.293413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.293607 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.293798 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.294045 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.294279 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.294436 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.294594 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.294748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.294961 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.295212 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.295382 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.295536 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.295695 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.295873 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.296034 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.296185 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.296335 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.296495 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.296654 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.296816 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.296967 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.297118 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.297276 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.297445 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.297674 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.297913 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.298087 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.298368 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.298539 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.298699 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.298858 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.299053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.299208 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.299360 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.299510 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.299661 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.299821 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.299982 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.300133 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.300295 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.300445 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.300595 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.300755 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.300906 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.301057 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.301215 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.301372 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.301523 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.301688 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.301847 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.301998 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.302150 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.302310 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.302462 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.302625 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.302778 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.302947 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.303118 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.303381 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.303552 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.303713 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.303865 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.304043 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.304295 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.304545 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.304713 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.304874 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.305046 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.305208 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.305386 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.305634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.305867 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.306022 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.306173 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.306334 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.306494 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.306494 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.306807 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.307038 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.307288 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.307288 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.307754 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.308040 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.308226 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.308502 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.308714 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.308908 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.309088 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.309807 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.309981 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.310151 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.310310 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.310469 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.310627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.310627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.310963 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.311138 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.311300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.311458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.311621 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.311786 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.311944 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.312106 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.312268 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.312429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.312596 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.312756 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.312913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.313072 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.313231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.313389 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.313553 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.313713 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.313874 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.314032 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.314189 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.314448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.314725 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.314892 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.315133 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.315294 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.315452 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.315621 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.315886 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.316131 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.316334 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.316502 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.316660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.316838 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.316838 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.317145 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.317308 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.317459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.317616 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.317783 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.317941 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.318263 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.318431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.318688 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.318849 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.319044 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.319217 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.319376 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.319791 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.319957 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.320116 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.320281 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.320443 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.320606 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.320769 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.320929 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.321095 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.321264 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.321541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.321736 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.321899 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.322052 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.322217 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.322376 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.322540 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.322699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.322861 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.323051 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.323218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.323376 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.323535 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.323703 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.323876 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.324039 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.324209 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.324372 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.324613 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.324912 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.325585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.325759 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.325759 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.325759 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.325759 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.325759 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.325759 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.326761 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.326983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.327154 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.327314 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.327477 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.327642 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.327642 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.327948 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.328108 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.328291 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.328532 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.328706 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.328944 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.329101 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.329261 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.329414 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.329579 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.329737 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.329895 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.330053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.330216 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.330376 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.330544 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.330695 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.330695 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.331027 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.331027 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.331328 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.331328 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.331710 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.331710 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.332006 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.332163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.332328 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.332483 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.332642 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.332794 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.332959 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.333118 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.333287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.333439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.333599 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.333758 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.333916 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.334067 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.334235 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.334387 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.334538 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.334793 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.335107 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.335296 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.335450 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.335610 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.335773 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.335933 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.336210 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.336387 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.336541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.336701 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.336864 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.337026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.337179 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.337340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.337555 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.337723 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.337886 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.338046 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.338207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.338372 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.338553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.338782 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.338782 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.339197 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.339364 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.339517 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.339678 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.339839 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.340002 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.340160 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.340325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.340511 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.340679 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.340833 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.340985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.341146 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.341310 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.341476 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.341628 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.341795 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.341948 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.341948 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.342255 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.342406 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.342556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.342712 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.342869 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.343072 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.343229 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.343380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.343536 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.343696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.343858 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.344019 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.344171 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.344379 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.344583 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.344763 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.344994 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.345247 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.345424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.345579 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.345730 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.345889 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.346045 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.346272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.346647 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.346869 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.347117 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.347289 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.347475 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.347689 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.347860 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.348021 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.348181 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.348346 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.348508 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.348674 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.348924 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.349082 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.349327 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.349327 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.349639 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.349793 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.349944 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.350103 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.350262 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.350424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.350588 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.350748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.350911 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.351089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.351241 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.351411 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.351575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.351575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.351891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.352050 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.352202 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.352363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.352525 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.352677 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.352847 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.353013 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.353279 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.353452 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.353606 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.353765 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.353927 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.354078 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.354244 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.354407 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.354561 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.354712 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.354870 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.355247 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.355532 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.355736 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.355944 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.355944 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.356911 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.357081 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.357244 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.357403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.357555 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.357717 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.357876 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.358044 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.358139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.358251 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.358324 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.358409 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.358502 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.358604 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.358691 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.358784 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.358895 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.359000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.359076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.359162 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.359247 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.359492 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.359583 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.359665 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.359745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.359829 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.359910 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.359991 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.360071 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.360145 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.360230 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.360312 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.360392 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.360467 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.360538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.360617 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.360699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.360779 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.360858 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.360931 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.360931 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.361070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.361228 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.361304 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.361384 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.361462 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.361544 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.361625 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.361625 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.361625 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.361625 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.361625 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.361948 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.362035 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.362109 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.362180 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.362258 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.362335 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.362407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.362491 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.362571 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.362653 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.362653 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.362791 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.362869 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.362995 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.363075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.363147 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.363218 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.363302 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.363389 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.363470 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.363470 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.363608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.363687 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.363767 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.363849 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.363922 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.364000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.364082 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.364156 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.364238 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.364323 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.364403 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.364482 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.364561 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.364635 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.364712 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.364793 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.364876 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.364960 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.364960 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.365110 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.365110 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.365110 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.365110 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.365110 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.365445 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.365696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.365788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.365869 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.365943 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.366015 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.366015 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.366162 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.366246 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.366325 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.366397 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.366469 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.366540 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.366620 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.366694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.366773 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.366846 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.366953 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.367043 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.367043 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.367192 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.367265 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.367343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.367422 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.367501 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.367583 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.367656 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.367728 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.367799 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.367870 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.367870 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.368018 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.368097 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.368170 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.368241 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.368241 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.368383 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.368456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.368534 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.368620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.368694 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.368775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.368860 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.368939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.369021 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.369094 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.369172 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.369253 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.369342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.369649 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.369745 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.369820 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.369820 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.369959 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.370040 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.370120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.370206 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.370281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.370353 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.370432 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.370432 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.370577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.370656 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.370729 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.370807 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.370886 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.371063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.371421 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.371506 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.372422 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.372525 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.372811 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.372894 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.373130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.373213 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.373478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.373583 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.373807 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.374129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.374221 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.374454 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.374539 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.374875 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.374985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.380525 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.380639 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.380720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.380795 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.380884 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.380960 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.381045 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.381126 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.381198 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.381279 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.381352 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.381431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.381510 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.381583 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.381661 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.381746 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.381820 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.381820 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.381949 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.382020 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.382092 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.382092 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.382237 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.382317 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.382390 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.382461 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.382540 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.382618 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.382698 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.382786 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.382866 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.382964 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.383059 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.383139 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.383218 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.383301 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.383378 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.383450 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.385079 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.385209 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.387559 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.387741 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.387897 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.388055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.388297 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.388454 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.388607 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.388821 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.388982 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.389154 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.389319 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.389319 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.389619 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.390204 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.390360 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.390527 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.390681 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.390886 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.390886 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.390886 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.390886 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.390886 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.390886 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.390886 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.390886 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.392133 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.392297 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.392458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.392683 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.392850 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.393041 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.393212 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.393421 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.393589 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.393880 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.394086 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.394246 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.394467 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.394693 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.394693 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.395236 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.395406 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.395614 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.395778 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.395941 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.396135 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.396303 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.396506 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.396673 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.396840 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.397121 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.397328 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.397485 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.397685 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.397685 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.398107 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.398271 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.398483 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.398643 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.398803 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.398974 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.398974 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.399284 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.399456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.399609 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.400209 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.400209 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.400209 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.400758 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.401064 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.401064 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.401497 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.401728 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.401930 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.402184 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.402358 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.402654 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.402895 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.403211 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.403433 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.403686 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.404190 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.404610 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.404610 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.405338 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.405775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.405992 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.406190 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.406406 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.406571 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.406738 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.406892 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.407070 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.407223 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.407389 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.407555 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.407708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.407866 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.408019 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.408177 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.408177 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.408623 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.408783 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.408936 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.409151 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.409414 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.409718 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.409945 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.410403 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.410403 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.410850 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.411057 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.411226 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.411397 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.411397 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.411397 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.411884 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.412040 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.412040 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.412976 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.413148 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.413305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.413466 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.413466 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.413466 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.414270 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.414447 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.414603 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.414755 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.414755 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.415080 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.415234 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.415234 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.415561 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.415820 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.416048 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.416174 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.416288 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.416412 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.416536 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.416650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.416772 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.416887 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.417010 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.417135 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.417257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.417374 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.417495 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.417617 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.417740 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.417854 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.417854 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.417854 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.417854 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 19:42:48.418320 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.418320 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.418320 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.418320 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.418320 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.418320 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.418320 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.418320 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.475439 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.475439 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.475439 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.475439 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.475439 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.475439 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.475439 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.475439 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.475992 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.475992 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.475992 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.475992 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.475992 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.475992 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.475992 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.475992 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.476955 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.476955 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.476955 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.476955 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.476955 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.476955 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.476955 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.476955 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.477556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.477556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.477556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.477556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.477556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.477556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.477556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.477556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.478067 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.478067 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.478067 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.478067 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.478067 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.478067 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.478067 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.478067 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.478576 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.478576 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.478576 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.478576 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.478576 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.478576 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.478576 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.478576 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.479115 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.479115 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.479115 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.479115 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.479115 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.479115 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.479115 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.479115 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.479728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.479728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.479728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.479728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.479728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.479728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.479728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.479728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.480342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.480342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.480342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.480342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.480342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.480342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.480342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.480342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.480952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.480952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.480952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.480952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.480952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.480952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 19:42:48.480952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 19:42:48.482089 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO dbcounter [None req-69f34e2d-604e-4f5c-9276-c9bee729a380 None None] Registered counter for database nova_api Jun 16 19:42:48.498540 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_db.sqlalchemy.engines [None req-69f34e2d-604e-4f5c-9276-c9bee729a380 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 19:42:48.505508 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writer thread running {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 19:42:48.506578 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO dbcounter [None req-ddde0aed-2edb-4c1d-904f-366c170d3c84 None None] Registered counter for database nova_api Jun 16 19:42:48.526757 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_db.sqlalchemy.engines [None req-ddde0aed-2edb-4c1d-904f-366c170d3c84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 19:42:48.533405 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writer thread running {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 19:42:48.562712 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.context [None req-69f34e2d-604e-4f5c-9276-c9bee729a380 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cb00b46e-9042-4ea9-a634-b4f1cf1f3046(cell1) {{(pid=124550) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 19:42:48.566873 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-69f34e2d-604e-4f5c-9276-c9bee729a380 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:48.568459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-69f34e2d-604e-4f5c-9276-c9bee729a380 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:48.569275 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-69f34e2d-604e-4f5c-9276-c9bee729a380 None None] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:48.571502 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-69f34e2d-604e-4f5c-9276-c9bee729a380 None None] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:48.573497 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO dbcounter [None req-69f34e2d-604e-4f5c-9276-c9bee729a380 None None] Registered counter for database nova_cell0 Jun 16 19:42:48.577388 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO dbcounter [None req-69f34e2d-604e-4f5c-9276-c9bee729a380 None None] Registered counter for database nova_cell1 Jun 16 19:42:48.585601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_db.sqlalchemy.engines [None req-69f34e2d-604e-4f5c-9276-c9bee729a380 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 19:42:48.586797 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_db.sqlalchemy.engines [None req-69f34e2d-604e-4f5c-9276-c9bee729a380 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 19:42:48.592216 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writer thread running {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 19:42:48.592458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.context [None req-ddde0aed-2edb-4c1d-904f-366c170d3c84 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cb00b46e-9042-4ea9-a634-b4f1cf1f3046(cell1) {{(pid=124551) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 19:42:48.593844 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writer thread running {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 19:42:48.597051 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ddde0aed-2edb-4c1d-904f-366c170d3c84 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:48.598625 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ddde0aed-2edb-4c1d-904f-366c170d3c84 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:48.599654 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ddde0aed-2edb-4c1d-904f-366c170d3c84 None None] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:42:48.601628 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ddde0aed-2edb-4c1d-904f-366c170d3c84 None None] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:42:48.603654 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO dbcounter [None req-ddde0aed-2edb-4c1d-904f-366c170d3c84 None None] Registered counter for database nova_cell0 Jun 16 19:42:48.608055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO dbcounter [None req-ddde0aed-2edb-4c1d-904f-366c170d3c84 None None] Registered counter for database nova_cell1 Jun 16 19:42:48.615587 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_db.sqlalchemy.engines [None req-ddde0aed-2edb-4c1d-904f-366c170d3c84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 19:42:48.617383 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_db.sqlalchemy.engines [None req-ddde0aed-2edb-4c1d-904f-366c170d3c84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 19:42:48.623849 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writer thread running {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 19:42:48.741385 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO dbcounter [None req-69f34e2d-604e-4f5c-9276-c9bee729a380 None None] Registered counter for database nova_cell0 Jun 16 19:42:48.748530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_db.sqlalchemy.engines [None req-69f34e2d-604e-4f5c-9276-c9bee729a380 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 19:42:48.752895 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writer thread running {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 19:42:48.767891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writer thread running {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 19:42:48.778259 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO dbcounter [None req-ddde0aed-2edb-4c1d-904f-366c170d3c84 None None] Registered counter for database nova_cell0 Jun 16 19:42:48.785046 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_db.sqlalchemy.engines [None req-ddde0aed-2edb-4c1d-904f-366c170d3c84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 19:42:48.789666 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writer thread running {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 19:42:49.069112 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: WARNING keystonemiddleware.auth_token [None req-69f34e2d-604e-4f5c-9276-c9bee729a380 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 19:42:49.077173 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: WARNING keystonemiddleware.auth_token [None req-69f34e2d-604e-4f5c-9276-c9bee729a380 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 19:42:49.116144 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: WARNING keystonemiddleware.auth_token [None req-ddde0aed-2edb-4c1d-904f-366c170d3c84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 19:42:49.127631 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: WARNING keystonemiddleware.auth_token [None req-ddde0aed-2edb-4c1d-904f-366c170d3c84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 19:42:49.423942 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: WARNING keystonemiddleware.auth_token [None req-69f34e2d-604e-4f5c-9276-c9bee729a380 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 19:42:49.428983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: WARNING keystonemiddleware.auth_token [None req-69f34e2d-604e-4f5c-9276-c9bee729a380 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 19:42:49.434837 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e5913429c0 pid: 124550 (default app) Jun 16 19:42:49.477692 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: WARNING keystonemiddleware.auth_token [None req-ddde0aed-2edb-4c1d-904f-366c170d3c84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 19:42:49.484416 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: WARNING keystonemiddleware.auth_token [None req-ddde0aed-2edb-4c1d-904f-366c170d3c84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 19:42:49.489754 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e5913429c0 pid: 124551 (default app) Jun 16 19:43:31.049601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:43:31.052073 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:43:31.053014 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:43:31.054165 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:43:31.715948 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=3 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:43:31.721200 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=3 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:43:31.722011 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=3 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:43:31.725090 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=3 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:43:32.410210 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4c6a5b60-1a07-44cf-bfee-620775d7f813 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] Action: 'create', calling method: .version_select at 0x7f05033f2790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-251051574", "metadata": {"Type": "work"}}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4c6a5b60-1a07-44cf-bfee-620775d7f813 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] Request method failure captured: Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 121 Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4fi-LREYnLhwHJCUOneoj7IEVm_IGj6OTx6_loHEawQmXTFIFVcN1vzaRfrtF-C4pgKs_70oWa6Ha2V6SGKwWyrwienxj_iOTOsPmIRZzXIDTwR0_W0fLeBcr-KIGcHCfn-rkgYgm8Kl5_5ejDEQf5T__8jxkrRtnY-7BcGuswQxjI Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 9f531d0fe3d64ff6ba4d2e960f5ee84a Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesNegativeTest-187431066 Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:43:32.431699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:43:32.433243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f531d0fe3d64ff6ba4d2e960f5ee84a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9f531d0fe3d64ff6ba4d2e960f5ee84a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9f531d0fe3d64ff6ba4d2e960f5ee84a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f531d0fe3d64ff6ba4d2e960f5ee84a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:43:32.433243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesNegativeTest-187431066 Jun 16 19:43:32.433243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 9f531d0fe3d64ff6ba4d2e960f5ee84a Jun 16 19:43:32.433243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesNegativeTest-187431066 Jun 16 19:43:32.433243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesNegativeTest-187431066-project Jun 16 19:43:32.433243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:43:32.433243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:43:32.433243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 192c8d39e40349c7b595f1a423d7a521 Jun 16 19:43:32.433243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesNegativeTest-187431066-project Jun 16 19:43:32.433243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Jun 16 19:43:32.433243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-251051574", "metadata": {"Type": "work"}}} Jun 16 19:43:32.433243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: Jun 16 19:43:32.433243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-251051574', 'metadata': {'Type': 'work'}}}} Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise error Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:43:32.434129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:43:32.435823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:43:32.435823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:43:32.435823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:43:32.435823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:43:32.435823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 19:43:32.435823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 19:43:32.435823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 19:43:32.435823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 19:43:32.435823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 19:43:32.435823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 19:43:32.435823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 19:43:32.435823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.435823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:32.435823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.435823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:32.435823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:43:32.435823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:43:32.435823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 19:43:32.435823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 19:43:32.437519 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 19:43:32.437519 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.437519 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4c6a5b60-1a07-44cf-bfee-620775d7f813 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:43:32.438223 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4c6a5b60-1a07-44cf-bfee-620775d7f813 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.401450 Jun 16 19:43:32.439292 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1155 bytes} [Thu Jun 16 19:43:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1404 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-53adfc21-3a5c-467a-9f78-74572f956987 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] Action: 'create', calling method: .version_select at 0x7f05033aea60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1453874960", "metadata": {"Type": "work"}}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-53adfc21-3a5c-467a-9f78-74572f956987 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] Request method failure captured: Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 120 Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4fi-LREYnLhwHJCUOneoj7IEVm_IGj6OTx6_loHEawQmXTFIFVcN1vzaRfrtF-C4pgKs_70oWa6Ha2V6SGKwWyrwienxj_iOTOsPmIRZzXIDTwR0_W0fLeBcr-KIGcHCfn-rkgYgm8Kl5_5ejDEQf5T__8jxkrRtnY-7BcGuswQxjI Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 9f531d0fe3d64ff6ba4d2e960f5ee84a Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesNegativeTest-187431066 Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:43:32.459306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:43:32.460622 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f531d0fe3d64ff6ba4d2e960f5ee84a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9f531d0fe3d64ff6ba4d2e960f5ee84a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9f531d0fe3d64ff6ba4d2e960f5ee84a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f531d0fe3d64ff6ba4d2e960f5ee84a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:43:32.460622 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesNegativeTest-187431066 Jun 16 19:43:32.460622 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 9f531d0fe3d64ff6ba4d2e960f5ee84a Jun 16 19:43:32.460622 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesNegativeTest-187431066 Jun 16 19:43:32.460622 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesNegativeTest-187431066-project Jun 16 19:43:32.460622 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:43:32.460622 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:43:32.460622 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 192c8d39e40349c7b595f1a423d7a521 Jun 16 19:43:32.460622 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesNegativeTest-187431066-project Jun 16 19:43:32.460622 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Jun 16 19:43:32.460622 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1453874960", "metadata": {"Type": "work"}}} Jun 16 19:43:32.460622 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: Jun 16 19:43:32.460622 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1453874960', 'metadata': {'Type': 'work'}}}} Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise error Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi '0' Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:43:32.461396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:43:32.462652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:43:32.462652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:43:32.462652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:43:32.462652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:43:32.462652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 19:43:32.462652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 19:43:32.462652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 19:43:32.462652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 19:43:32.462652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 19:43:32.462652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 19:43:32.462652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 19:43:32.462652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.462652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:32.462652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.462652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:32.462652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:43:32.462652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:43:32.462652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 19:43:32.462652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 19:43:32.463868 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 19:43:32.463868 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.463868 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-53adfc21-3a5c-467a-9f78-74572f956987 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:43:32.463868 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-53adfc21-3a5c-467a-9f78-74572f956987 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009327 Jun 16 19:43:32.463868 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 2/2] 10.222.0.36 () {60 vars in 1155 bytes} [Thu Jun 16 19:43:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:43:32.466193 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e66cf9f2-e2fd-4a1b-8010-52097120d138 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] Action: 'create', calling method: .version_select at 0x7f05033f2af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-331601325", "metadata": {"Type": "work"}}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e66cf9f2-e2fd-4a1b-8010-52097120d138 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] Request method failure captured: Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 118 Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4fi-LREYnLhwHJCUOneoj7IEVm_IGj6OTx6_loHEawQmXTFIFVcN1vzaRfrtF-C4pgKs_70oWa6Ha2V6SGKwWyrwienxj_iOTOsPmIRZzXIDTwR0_W0fLeBcr-KIGcHCfn-rkgYgm8Kl5_5ejDEQf5T__8jxkrRtnY-7BcGuswQxjI Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 9f531d0fe3d64ff6ba4d2e960f5ee84a Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesNegativeTest-187431066 Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:43:32.469569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:43:32.477805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f531d0fe3d64ff6ba4d2e960f5ee84a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9f531d0fe3d64ff6ba4d2e960f5ee84a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9f531d0fe3d64ff6ba4d2e960f5ee84a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f531d0fe3d64ff6ba4d2e960f5ee84a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:43:32.477805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesNegativeTest-187431066 Jun 16 19:43:32.477805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 9f531d0fe3d64ff6ba4d2e960f5ee84a Jun 16 19:43:32.477805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesNegativeTest-187431066 Jun 16 19:43:32.477805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesNegativeTest-187431066-project Jun 16 19:43:32.477805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:43:32.477805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:43:32.477805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 192c8d39e40349c7b595f1a423d7a521 Jun 16 19:43:32.477805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesNegativeTest-187431066-project Jun 16 19:43:32.477805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Jun 16 19:43:32.477805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-331601325", "metadata": {"Type": "work"}}} Jun 16 19:43:32.477805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: Jun 16 19:43:32.477805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-331601325', 'metadata': {'Type': 'work'}}}} Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise error Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi '' Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:43:32.478604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:43:32.480495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:43:32.480495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:43:32.480495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:43:32.480495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:43:32.480495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 19:43:32.480495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 19:43:32.480495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 19:43:32.480495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 19:43:32.480495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 19:43:32.480495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 19:43:32.480495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 19:43:32.480495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.480495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:32.480495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.480495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:32.480495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:43:32.480495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:43:32.480495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 19:43:32.480495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 19:43:32.481637 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 19:43:32.481637 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:32.481637 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e66cf9f2-e2fd-4a1b-8010-52097120d138 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:43:32.481637 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e66cf9f2-e2fd-4a1b-8010-52097120d138 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009967 Jun 16 19:43:32.481637 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 3/3] 10.222.0.36 () {60 vars in 1155 bytes} [Thu Jun 16 19:43:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:43:32.486588 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6591d041-660e-49af-9cbe-abb218a926e2 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] Calling method '.version_select at 0x7f050331e700>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:32.913704 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-46020561-742a-45fa-911d-3f1b2e19a457 tempest-VolumesGetTestJSON-1212982113 tempest-VolumesGetTestJSON-1212982113-project] Action: 'create', calling method: .version_select at 0x7f05033f2790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1730427942", "metadata": {"Type": "work"}}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:43:33.359154 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-6591d041-660e-49af-9cbe-abb218a926e2 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] HTTP exception thrown: Volume tempest-invalid-516342507 could not be found. Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6591d041-660e-49af-9cbe-abb218a926e2 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] Request method failure captured: Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-516342507 HTTP/1.1 Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4fi-LREYnLhwHJCUOneoj7IEVm_IGj6OTx6_loHEawQmXTFIFVcN1vzaRfrtF-C4pgKs_70oWa6Ha2V6SGKwWyrwienxj_iOTOsPmIRZzXIDTwR0_W0fLeBcr-KIGcHCfn-rkgYgm8Kl5_5ejDEQf5T__8jxkrRtnY-7BcGuswQxjI Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 9f531d0fe3d64ff6ba4d2e960f5ee84a Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesNegativeTest-187431066 Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:43:33.366775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:43:33.368163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f531d0fe3d64ff6ba4d2e960f5ee84a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9f531d0fe3d64ff6ba4d2e960f5ee84a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9f531d0fe3d64ff6ba4d2e960f5ee84a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f531d0fe3d64ff6ba4d2e960f5ee84a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:43:33.368163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesNegativeTest-187431066 Jun 16 19:43:33.368163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 9f531d0fe3d64ff6ba4d2e960f5ee84a Jun 16 19:43:33.368163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesNegativeTest-187431066 Jun 16 19:43:33.368163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesNegativeTest-187431066-project Jun 16 19:43:33.368163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:43:33.368163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:43:33.368163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 192c8d39e40349c7b595f1a423d7a521 Jun 16 19:43:33.368163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesNegativeTest-187431066-project Jun 16 19:43:33.368163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: Jun 16 19:43:33.368163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Volume tempest-invalid-516342507 could not be found. Jun 16 19:43:33.368163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': 'tempest-invalid-516342507'} Jun 16 19:43:33.368163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:43:33.368983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:33.368983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:43:33.368983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:43:33.368983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 19:43:33.368983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 19:43:33.368983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 19:43:33.368983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 19:43:33.368983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 19:43:33.368983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 19:43:33.368983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 19:43:33.368983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 19:43:33.368983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:43:33.368983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:43:33.368983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:43:33.368983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:43:33.368983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-516342507 could not be found. (HTTP 404) (Request-ID: req-845bc378-afde-4cb1-9277-28741635a9d7) Jun 16 19:43:33.368983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:33.368983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:33.368983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:33.370170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:33.370170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 19:43:33.370170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 19:43:33.370170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 19:43:33.370170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 19:43:33.370170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 19:43:33.370170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 19:43:33.370170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 19:43:33.370170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 19:43:33.370170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:43:33.370170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:43:33.370170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 19:43:33.370170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 19:43:33.370170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 19:43:33.370170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 19:43:33.370170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 19:43:33.370170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 19:43:33.370170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 19:43:33.370170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-516342507 could not be found. Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:43:33.375036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-516342507 could not be found. Jun 16 19:43:33.377677 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:33.377677 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:33.377677 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:33.377677 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:33.377677 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:43:33.377677 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:43:33.377677 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:43:33.377677 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:43:33.377677 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-516342507 could not be found. Jun 16 19:43:33.377677 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:33.380717 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6591d041-660e-49af-9cbe-abb218a926e2 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] Returning 404 to user: Volume tempest-invalid-516342507 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:43:33.385399 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6591d041-660e-49af-9cbe-abb218a926e2 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-516342507" status: 404 len: 98 microversion: 2.1 time: 0.902922 Jun 16 19:43:33.386719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 4/4] 10.222.0.36 () {58 vars in 1214 bytes} [Thu Jun 16 19:43:32 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-516342507 => generated 98 bytes in 909 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 19:43:33.397310 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7ef61bfc-0bf4-4ba0-a131-eaf3c790a0c9 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004981 Jun 16 19:43:33.403903 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 5/5] 10.222.0.36 () {58 vars in 1139 bytes} [Thu Jun 16 19:43:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 19:43:33.417979 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-88b80172-df1f-4c6a-9a0e-4bee6450ac9a tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008609 Jun 16 19:43:33.457844 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 6/6] 10.222.0.36 () {58 vars in 1136 bytes} [Thu Jun 16 19:43:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 19:43:33.475935 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-94ca380f-0ea8-410f-8eb8-4503409cc4d5 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] Calling method '.version_select at 0x7f050324caf0>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-94ca380f-0ea8-410f-8eb8-4503409cc4d5 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] HTTP exception thrown: Volume 913244b5-eb77-4e61-8eb2-f575191968d0 could not be found. Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-94ca380f-0ea8-410f-8eb8-4503409cc4d5 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] Request method failure captured: Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: DELETE /compute/v2.1/os-volumes/913244b5-eb77-4e61-8eb2-f575191968d0 HTTP/1.1 Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4fi-LREYnLhwHJCUOneoj7IEVm_IGj6OTx6_loHEawQmXTFIFVcN1vzaRfrtF-C4pgKs_70oWa6Ha2V6SGKwWyrwienxj_iOTOsPmIRZzXIDTwR0_W0fLeBcr-KIGcHCfn-rkgYgm8Kl5_5ejDEQf5T__8jxkrRtnY-7BcGuswQxjI Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 9f531d0fe3d64ff6ba4d2e960f5ee84a Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesNegativeTest-187431066 Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:43:34.868681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:43:34.876007 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f531d0fe3d64ff6ba4d2e960f5ee84a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9f531d0fe3d64ff6ba4d2e960f5ee84a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9f531d0fe3d64ff6ba4d2e960f5ee84a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f531d0fe3d64ff6ba4d2e960f5ee84a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:43:34.876007 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesNegativeTest-187431066 Jun 16 19:43:34.876007 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 9f531d0fe3d64ff6ba4d2e960f5ee84a Jun 16 19:43:34.876007 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesNegativeTest-187431066 Jun 16 19:43:34.876007 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesNegativeTest-187431066-project Jun 16 19:43:34.876007 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:43:34.876007 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:43:34.876007 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 192c8d39e40349c7b595f1a423d7a521 Jun 16 19:43:34.876007 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesNegativeTest-187431066-project Jun 16 19:43:34.876007 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: Jun 16 19:43:34.876007 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Volume 913244b5-eb77-4e61-8eb2-f575191968d0 could not be found. Jun 16 19:43:34.876007 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': '913244b5-eb77-4e61-8eb2-f575191968d0'} Jun 16 19:43:34.876007 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:43:34.877456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:34.877456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:43:34.877456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:43:34.877456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 19:43:34.877456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 19:43:34.877456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 19:43:34.877456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 19:43:34.877456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 19:43:34.877456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 19:43:34.877456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 19:43:34.877456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 19:43:34.877456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:43:34.877456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:43:34.877456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:43:34.877456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:43:34.877456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 913244b5-eb77-4e61-8eb2-f575191968d0 could not be found. (HTTP 404) (Request-ID: req-33d094d1-08c1-4af4-8b41-83ec9e2f10b4) Jun 16 19:43:34.877456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:34.877456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:34.877456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:34.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:34.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 19:43:34.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 19:43:34.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 19:43:34.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 19:43:34.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 19:43:34.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 19:43:34.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 19:43:34.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 19:43:34.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:43:34.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:43:34.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 19:43:34.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 19:43:34.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 19:43:34.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 19:43:34.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 19:43:34.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 19:43:34.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 19:43:34.887199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 19:43:34.890568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:43:34.890568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:43:34.890568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:43:34.890568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:43:34.890568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 913244b5-eb77-4e61-8eb2-f575191968d0 could not be found. Jun 16 19:43:34.890568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:34.890568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:34.890568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:34.890568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:34.890568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:43:34.890568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:43:34.890568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:43:34.890568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:43:34.890568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:43:34.890568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:43:34.890568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:43:34.890568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:43:34.890568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 19:43:34.890568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:43:34.891500 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 913244b5-eb77-4e61-8eb2-f575191968d0 could not be found. Jun 16 19:43:34.891500 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:34.891500 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:34.891500 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:34.891500 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:34.891500 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:43:34.891500 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:43:34.891500 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:43:34.891500 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:43:34.891500 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 913244b5-eb77-4e61-8eb2-f575191968d0 could not be found. Jun 16 19:43:34.891500 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:34.891500 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-94ca380f-0ea8-410f-8eb8-4503409cc4d5 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] Returning 404 to user: Volume 913244b5-eb77-4e61-8eb2-f575191968d0 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:43:34.891500 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-94ca380f-0ea8-410f-8eb8-4503409cc4d5 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/913244b5-eb77-4e61-8eb2-f575191968d0" status: 404 len: 109 microversion: 2.1 time: 1.279111 Jun 16 19:43:34.891500 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 7/7] 10.222.0.36 () {58 vars in 1247 bytes} [Thu Jun 16 19:43:33 2022] DELETE /compute/v2.1/os-volumes/913244b5-eb77-4e61-8eb2-f575191968d0 => generated 109 bytes in 1285 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bab224a5-584c-498b-8859-00e22112e258 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] Calling method '.version_select at 0x7f050324c670>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-bab224a5-584c-498b-8859-00e22112e258 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] HTTP exception thrown: Volume 0f60df60-c363-4fb5-918d-4907ad099d0e could not be found. Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bab224a5-584c-498b-8859-00e22112e258 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] Request method failure captured: Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/os-volumes/0f60df60-c363-4fb5-918d-4907ad099d0e HTTP/1.1 Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4fi-LREYnLhwHJCUOneoj7IEVm_IGj6OTx6_loHEawQmXTFIFVcN1vzaRfrtF-C4pgKs_70oWa6Ha2V6SGKwWyrwienxj_iOTOsPmIRZzXIDTwR0_W0fLeBcr-KIGcHCfn-rkgYgm8Kl5_5ejDEQf5T__8jxkrRtnY-7BcGuswQxjI Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 9f531d0fe3d64ff6ba4d2e960f5ee84a Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesNegativeTest-187431066 Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:43:34.892192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:43:34.895706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f531d0fe3d64ff6ba4d2e960f5ee84a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9f531d0fe3d64ff6ba4d2e960f5ee84a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9f531d0fe3d64ff6ba4d2e960f5ee84a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f531d0fe3d64ff6ba4d2e960f5ee84a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:43:34.895706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesNegativeTest-187431066 Jun 16 19:43:34.895706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 9f531d0fe3d64ff6ba4d2e960f5ee84a Jun 16 19:43:34.895706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesNegativeTest-187431066 Jun 16 19:43:34.895706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesNegativeTest-187431066-project Jun 16 19:43:34.895706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:43:34.895706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:43:34.895706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 192c8d39e40349c7b595f1a423d7a521 Jun 16 19:43:34.895706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesNegativeTest-187431066-project Jun 16 19:43:34.895706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: Jun 16 19:43:34.895706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Volume 0f60df60-c363-4fb5-918d-4907ad099d0e could not be found. Jun 16 19:43:34.895706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': '0f60df60-c363-4fb5-918d-4907ad099d0e'} Jun 16 19:43:34.895706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:43:34.896966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:34.896966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:43:34.896966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:43:34.896966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 19:43:34.896966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 19:43:34.896966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 19:43:34.896966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 19:43:34.896966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:43:34.896966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:43:34.896966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:43:34.896966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:43:34.896966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:43:34.896966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:43:34.896966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:43:34.896966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:43:34.896966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0f60df60-c363-4fb5-918d-4907ad099d0e could not be found. (HTTP 404) (Request-ID: req-68ac808e-5e21-43ad-848d-324a24126789) Jun 16 19:43:34.896966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:34.896966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:34.896966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:34.900849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:34.900849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 19:43:34.900849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 19:43:34.900849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 19:43:34.900849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 19:43:34.900849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 19:43:34.900849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 19:43:34.900849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 19:43:34.900849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 19:43:34.900849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:43:34.900849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:43:34.900849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 19:43:34.900849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 19:43:34.900849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 19:43:34.900849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 19:43:34.900849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:43:34.900849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:43:34.900849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:43:34.900849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:43:34.902650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:43:34.902650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:43:34.902650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:43:34.902650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:43:34.902650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0f60df60-c363-4fb5-918d-4907ad099d0e could not be found. Jun 16 19:43:34.902650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:34.902650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:34.902650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:34.902650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:34.902650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:43:34.902650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:43:34.902650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:43:34.902650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:43:34.902650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:43:34.902650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:43:34.902650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:43:34.902650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:43:34.902650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 19:43:34.902650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:43:34.906300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0f60df60-c363-4fb5-918d-4907ad099d0e could not be found. Jun 16 19:43:34.906300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:34.906300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:34.906300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:34.906300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:34.906300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:43:34.906300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:43:34.906300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:43:34.906300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:43:34.906300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0f60df60-c363-4fb5-918d-4907ad099d0e could not be found. Jun 16 19:43:34.906300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:34.906300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bab224a5-584c-498b-8859-00e22112e258 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] Returning 404 to user: Volume 0f60df60-c363-4fb5-918d-4907ad099d0e could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:43:34.906300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-bab224a5-584c-498b-8859-00e22112e258 tempest-VolumesNegativeTest-187431066 tempest-VolumesNegativeTest-187431066-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/0f60df60-c363-4fb5-918d-4907ad099d0e" status: 404 len: 109 microversion: 2.1 time: 0.085561 Jun 16 19:43:34.906300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 8/8] 10.222.0.36 () {58 vars in 1244 bytes} [Thu Jun 16 19:43:34 2022] GET /compute/v2.1/os-volumes/0f60df60-c363-4fb5-918d-4907ad099d0e => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:43:35.346966 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-46020561-742a-45fa-911d-3f1b2e19a457 tempest-VolumesGetTestJSON-1212982113 tempest-VolumesGetTestJSON-1212982113-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.641779 Jun 16 19:43:35.355100 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 1/9] 10.222.0.36 () {60 vars in 1155 bytes} [Thu Jun 16 19:43:31 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3645 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 19:43:35.362846 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cfd86a91-3861-47fc-82d5-bfdf7bc49bec tempest-VolumesGetTestJSON-1212982113 tempest-VolumesGetTestJSON-1212982113-project] Calling method '.version_select at 0x7f050324c9d0>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:35.452206 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cfd86a91-3861-47fc-82d5-bfdf7bc49bec tempest-VolumesGetTestJSON-1212982113 tempest-VolumesGetTestJSON-1212982113-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/44f230f0-7f19-4693-a2e8-a777ff6ed512" status: 200 len: 353 microversion: 2.1 time: 0.094877 Jun 16 19:43:35.467351 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 9/10] 10.222.0.36 () {58 vars in 1244 bytes} [Thu Jun 16 19:43:35 2022] GET /compute/v2.1/os-volumes/44f230f0-7f19-4693-a2e8-a777ff6ed512 => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:43:36.478134 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-2f208185-79e1-4df2-8452-b33a3091a83a tempest-VolumesGetTestJSON-1212982113 tempest-VolumesGetTestJSON-1212982113-project] Calling method '.version_select at 0x7f05032ae5e0>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:36.696705 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-2f208185-79e1-4df2-8452-b33a3091a83a tempest-VolumesGetTestJSON-1212982113 tempest-VolumesGetTestJSON-1212982113-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/44f230f0-7f19-4693-a2e8-a777ff6ed512" status: 200 len: 353 microversion: 2.1 time: 0.235632 Jun 16 19:43:36.697524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 2/11] 10.222.0.36 () {58 vars in 1244 bytes} [Thu Jun 16 19:43:36 2022] GET /compute/v2.1/os-volumes/44f230f0-7f19-4693-a2e8-a777ff6ed512 => generated 353 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:43:37.709645 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4ef20bf7-b07d-4e6e-bf92-d79f9c9187e6 tempest-VolumesGetTestJSON-1212982113 tempest-VolumesGetTestJSON-1212982113-project] Calling method '.version_select at 0x7f050325e280>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:37.780127 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4ef20bf7-b07d-4e6e-bf92-d79f9c9187e6 tempest-VolumesGetTestJSON-1212982113 tempest-VolumesGetTestJSON-1212982113-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/44f230f0-7f19-4693-a2e8-a777ff6ed512" status: 200 len: 354 microversion: 2.1 time: 0.074366 Jun 16 19:43:37.781117 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 10/12] 10.222.0.36 () {58 vars in 1244 bytes} [Thu Jun 16 19:43:37 2022] GET /compute/v2.1/os-volumes/44f230f0-7f19-4693-a2e8-a777ff6ed512 => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:43:37.795423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-defda649-2b89-4194-ba56-536e470b0dc6 tempest-VolumesGetTestJSON-1212982113 tempest-VolumesGetTestJSON-1212982113-project] Calling method '.version_select at 0x7f05032ae940>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:37.885461 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-defda649-2b89-4194-ba56-536e470b0dc6 tempest-VolumesGetTestJSON-1212982113 tempest-VolumesGetTestJSON-1212982113-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/44f230f0-7f19-4693-a2e8-a777ff6ed512" status: 200 len: 354 microversion: 2.1 time: 0.096820 Jun 16 19:43:37.889955 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 3/13] 10.222.0.36 () {58 vars in 1244 bytes} [Thu Jun 16 19:43:37 2022] GET /compute/v2.1/os-volumes/44f230f0-7f19-4693-a2e8-a777ff6ed512 => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:43:37.903682 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9e303e00-d8ca-4c0d-9288-5b39109fe380 tempest-VolumesGetTestJSON-1212982113 tempest-VolumesGetTestJSON-1212982113-project] Calling method '.version_select at 0x7f050325ec10>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:38.228658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9e303e00-d8ca-4c0d-9288-5b39109fe380 tempest-VolumesGetTestJSON-1212982113 tempest-VolumesGetTestJSON-1212982113-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/44f230f0-7f19-4693-a2e8-a777ff6ed512" status: 202 len: 0 microversion: 2.1 time: 0.327945 Jun 16 19:43:38.229997 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 11/14] 10.222.0.36 () {58 vars in 1247 bytes} [Thu Jun 16 19:43:37 2022] DELETE /compute/v2.1/os-volumes/44f230f0-7f19-4693-a2e8-a777ff6ed512 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:43:38.243890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-56e3f98c-8ec0-474a-a46e-abd9da7aa2e3 tempest-VolumesGetTestJSON-1212982113 tempest-VolumesGetTestJSON-1212982113-project] Calling method '.version_select at 0x7f05032aed30>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:38.337997 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-56e3f98c-8ec0-474a-a46e-abd9da7aa2e3 tempest-VolumesGetTestJSON-1212982113 tempest-VolumesGetTestJSON-1212982113-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/44f230f0-7f19-4693-a2e8-a777ff6ed512" status: 200 len: 353 microversion: 2.1 time: 0.100614 Jun 16 19:43:38.345767 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 4/15] 10.222.0.36 () {58 vars in 1244 bytes} [Thu Jun 16 19:43:38 2022] GET /compute/v2.1/os-volumes/44f230f0-7f19-4693-a2e8-a777ff6ed512 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:43:39.352484 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e6cddd0a-07c0-4f6b-8728-81a66e0b9cb5 tempest-VolumesGetTestJSON-1212982113 tempest-VolumesGetTestJSON-1212982113-project] Calling method '.version_select at 0x7f05031ee310>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:39.414890 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-e6cddd0a-07c0-4f6b-8728-81a66e0b9cb5 tempest-VolumesGetTestJSON-1212982113 tempest-VolumesGetTestJSON-1212982113-project] HTTP exception thrown: Volume 44f230f0-7f19-4693-a2e8-a777ff6ed512 could not be found. Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e6cddd0a-07c0-4f6b-8728-81a66e0b9cb5 tempest-VolumesGetTestJSON-1212982113 tempest-VolumesGetTestJSON-1212982113-project] Request method failure captured: Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/os-volumes/44f230f0-7f19-4693-a2e8-a777ff6ed512 HTTP/1.1 Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4fjG6cgsTpLDgpWTjNef__w-c9nT8UHpzwDz2YRGbdIsY0RJ4JxkhYtp0MEGeweF6qWLiwGb9fJEFoExZv_I3S64qpFgrj6neqrK_nTn_Uty8Kd9n3ZkUoGvb4_IIL6qcwTXafHdQhuyVtk7A0lE0_U04mlVpqV5ojCx6DfbQ7iOvQ Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 19487af2cbd5445d88ca0df1e308ccc3 Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesGetTestJSON-1212982113 Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:43:39.417694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:43:39.419988 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/19487af2cbd5445d88ca0df1e308ccc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/19487af2cbd5445d88ca0df1e308ccc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_19487af2cbd5445d88ca0df1e308ccc3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/19487af2cbd5445d88ca0df1e308ccc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:43:39.419988 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesGetTestJSON-1212982113 Jun 16 19:43:39.419988 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 19487af2cbd5445d88ca0df1e308ccc3 Jun 16 19:43:39.419988 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesGetTestJSON-1212982113 Jun 16 19:43:39.419988 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesGetTestJSON-1212982113-project Jun 16 19:43:39.419988 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:43:39.419988 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:43:39.419988 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: eb090bd3ce3741268abd614d943d21fb Jun 16 19:43:39.419988 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesGetTestJSON-1212982113-project Jun 16 19:43:39.419988 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: Jun 16 19:43:39.419988 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Volume 44f230f0-7f19-4693-a2e8-a777ff6ed512 could not be found. Jun 16 19:43:39.419988 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': '44f230f0-7f19-4693-a2e8-a777ff6ed512'} Jun 16 19:43:39.419988 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:43:39.420634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:39.420634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:43:39.420634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:43:39.420634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 19:43:39.420634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 19:43:39.420634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 19:43:39.420634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 19:43:39.420634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:43:39.420634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:43:39.420634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:43:39.420634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:43:39.420634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:43:39.420634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:43:39.420634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:43:39.420634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:43:39.420634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 44f230f0-7f19-4693-a2e8-a777ff6ed512 could not be found. (HTTP 404) (Request-ID: req-d34eef0d-8f2a-44f6-b61e-cd446fbd8ebc) Jun 16 19:43:39.420634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:39.420634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:39.420634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:39.421624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:39.421624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 19:43:39.421624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 19:43:39.421624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 19:43:39.421624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 19:43:39.421624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 19:43:39.421624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 19:43:39.421624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 19:43:39.421624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 19:43:39.421624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:43:39.421624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:43:39.421624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 19:43:39.421624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 19:43:39.421624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 19:43:39.421624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 19:43:39.421624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:43:39.421624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:43:39.421624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:43:39.421624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:43:39.422552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:43:39.422552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:43:39.422552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:43:39.422552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:43:39.422552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 44f230f0-7f19-4693-a2e8-a777ff6ed512 could not be found. Jun 16 19:43:39.422552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:39.422552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:39.422552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:39.422552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:39.422552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:43:39.422552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:43:39.422552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:43:39.422552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:43:39.422552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:43:39.422552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:43:39.422552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:43:39.422552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:43:39.422552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 19:43:39.422552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:43:39.423479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 44f230f0-7f19-4693-a2e8-a777ff6ed512 could not be found. Jun 16 19:43:39.423479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:39.423479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:43:39.423479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:39.423479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:43:39.423479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:43:39.423479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:43:39.423479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:43:39.423479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:43:39.423479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 44f230f0-7f19-4693-a2e8-a777ff6ed512 could not be found. Jun 16 19:43:39.423479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:43:39.423479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e6cddd0a-07c0-4f6b-8728-81a66e0b9cb5 tempest-VolumesGetTestJSON-1212982113 tempest-VolumesGetTestJSON-1212982113-project] Returning 404 to user: Volume 44f230f0-7f19-4693-a2e8-a777ff6ed512 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:43:39.426380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e6cddd0a-07c0-4f6b-8728-81a66e0b9cb5 tempest-VolumesGetTestJSON-1212982113 tempest-VolumesGetTestJSON-1212982113-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/44f230f0-7f19-4693-a2e8-a777ff6ed512" status: 404 len: 109 microversion: 2.1 time: 0.078735 Jun 16 19:43:39.430817 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 12/16] 10.222.0.36 () {58 vars in 1244 bytes} [Thu Jun 16 19:43:39 2022] GET /compute/v2.1/os-volumes/44f230f0-7f19-4693-a2e8-a777ff6ed512 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:43:43.413856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-ccff56bf-4d12-43ef-8183-a1df6a91b53e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Action: 'create', calling method: .version_select at 0x7f05032cc3a0>, body: {"keypair": {"name": "tempest-keypair-486232491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPeyHCLpCbt1zLzxs9GYDeZYJwXSgkqHvOF3jsKkzzHAgd2Csg6lya6k8hf70I0MC59fooNENAfZsuZhOyxRGxnI28xGhMVRvE03x91qGxU+2HH8VCKOQuNJ5MW80nrKw=="}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:43:43.525427 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-ccff56bf-4d12-43ef-8183-a1df6a91b53e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Getting quotas for project 38629fbda01748eb98e2dca20a3da10a. Resources: {'key_pairs'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:43:43.546044 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-ccff56bf-4d12-43ef-8183-a1df6a91b53e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Getting quotas for user 8b5a188cee0d4727a14153088b8d95c6 and project 38629fbda01748eb98e2dca20a3da10a. Resources: {'key_pairs'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:43:43.730229 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-ccff56bf-4d12-43ef-8183-a1df6a91b53e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.747015 Jun 16 19:43:43.731729 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 5/17] 10.222.0.36 () {62 vars in 1199 bytes} [Thu Jun 16 19:43:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 751 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 19:43:46.688866 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-987b8a36-3ae8-45db-85d2-9099800837bc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Action: 'create', calling method: .version_select at 0x7f050325e820>, body: {"keypair": {"name": "tempest-keypair-227914864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2u+fcsVdVfy5PTGNU6P30z95kdeFuQq8+N2qsLB9z8P6/rwNekv77dQc/v8NhTZZxkcPNK1zRcN+1crPM/cx/dUpwpKL2fpXJ9y9tT6PdGDbleCAFqT2V4uFrSscweNw=="}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:43:46.770774 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-987b8a36-3ae8-45db-85d2-9099800837bc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Getting quotas for project 47a4ab888dd74218ab5d7812ad095371. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:43:46.817328 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-987b8a36-3ae8-45db-85d2-9099800837bc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Getting quotas for user 4df05cbf303c4524a665b429f240a17a and project 47a4ab888dd74218ab5d7812ad095371. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:43:47.020764 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-987b8a36-3ae8-45db-85d2-9099800837bc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.577353 Jun 16 19:43:47.021365 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 13/18] 10.222.0.36 () {60 vars in 1158 bytes} [Thu Jun 16 19:43:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:43:48.809639 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6bb7ad42-015b-40c9-b868-a2454057c166 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1257899289", "imageRef": "9fcb2be6-02db-4853-a8d6-6478a75f26a3", "flavorRef": "452", "networks": [{"uuid": "699ce6e0-c422-425a-a3a5-b4517a531b94"}]}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:43:48.987590 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.network.neutron [None req-6bb7ad42-015b-40c9-b868-a2454057c166 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] validate_networks() for [('699ce6e0-c422-425a-a3a5-b4517a531b94', None, None, None, None, None)] {{(pid=124551) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:43:50.947698 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-6bb7ad42-015b-40c9-b868-a2454057c166 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Flavor limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:43:50.948850 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-6bb7ad42-015b-40c9-b868-a2454057c166 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Image limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:43:50.949135 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-6bb7ad42-015b-40c9-b868-a2454057c166 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Flavor pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:43:50.949525 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-6bb7ad42-015b-40c9-b868-a2454057c166 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Image pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:43:50.949935 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-6bb7ad42-015b-40c9-b868-a2454057c166 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:43:50.968430 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6bb7ad42-015b-40c9-b868-a2454057c166 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:50.968880 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6bb7ad42-015b-40c9-b868-a2454057c166 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:50.969680 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6bb7ad42-015b-40c9-b868-a2454057c166 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:50.970113 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6bb7ad42-015b-40c9-b868-a2454057c166 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:51.036887 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-6bb7ad42-015b-40c9-b868-a2454057c166 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Getting quotas for project 5544755ae458477d88d411b080a2517a. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:43:51.054567 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-6bb7ad42-015b-40c9-b868-a2454057c166 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Getting quotas for user d9320ca5b2a9499a86d5614b55eddede and project 5544755ae458477d88d411b080a2517a. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:43:51.088036 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6bb7ad42-015b-40c9-b868-a2454057c166 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Going to run 1 instances... {{(pid=124551) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:43:51.091806 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6bb7ad42-015b-40c9-b868-a2454057c166 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcb2be6-02db-4853-a8d6-6478a75f26a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:43:51.291655 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6bb7ad42-015b-40c9-b868-a2454057c166 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.609248 Jun 16 19:43:51.294284 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 6/19] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:43:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:43:51.315652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-887a1b1b-b07f-4eda-9402-034383f9d5e7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:51.322880 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-887a1b1b-b07f-4eda-9402-034383f9d5e7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:51.412617 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-304f0869-2a59-405c-9515-6dd7eb0ccdae tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-562285441", "imageRef": "9fcb2be6-02db-4853-a8d6-6478a75f26a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:43:51.698033 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-304f0869-2a59-405c-9515-6dd7eb0ccdae tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] validate_networks() for [('4c1db9f4-758f-4b75-b0a9-1383e34ed987', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:43:51.717556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-887a1b1b-b07f-4eda-9402-034383f9d5e7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:51.742281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-887a1b1b-b07f-4eda-9402-034383f9d5e7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1215 microversion: 2.1 time: 0.440243 Jun 16 19:43:51.743906 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 7/20] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:51 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1215 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:51.779289 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e7620343-392f-4076-a453-e1abf2fdef43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-235467447", "imageRef": "9fcb2be6-02db-4853-a8d6-6478a75f26a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44cabd56-11ef-4367-ae58-e8df153d2567"}], "security_groups": [{"name": "tempest-securitygroup--1944144431"}], "key_name": "tempest-keypair-486232491", "user_data": "}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:43:52.222176 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.network.neutron [None req-e7620343-392f-4076-a453-e1abf2fdef43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] validate_networks() for [('44cabd56-11ef-4367-ae58-e8df153d2567', None, None, None, None, None)] {{(pid=124551) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:43:53.627109 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-e7620343-392f-4076-a453-e1abf2fdef43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Flavor limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:43:53.627721 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-e7620343-392f-4076-a453-e1abf2fdef43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Image limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:43:53.627927 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-e7620343-392f-4076-a453-e1abf2fdef43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Flavor pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:43:53.628343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-e7620343-392f-4076-a453-e1abf2fdef43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Image pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:43:53.628909 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-e7620343-392f-4076-a453-e1abf2fdef43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:43:53.639831 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e7620343-392f-4076-a453-e1abf2fdef43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:53.640281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e7620343-392f-4076-a453-e1abf2fdef43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:53.641078 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e7620343-392f-4076-a453-e1abf2fdef43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:53.641504 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e7620343-392f-4076-a453-e1abf2fdef43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:53.665602 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-e7620343-392f-4076-a453-e1abf2fdef43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Getting quotas for project 38629fbda01748eb98e2dca20a3da10a. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:43:53.670875 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-e7620343-392f-4076-a453-e1abf2fdef43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Getting quotas for user 8b5a188cee0d4727a14153088b8d95c6 and project 38629fbda01748eb98e2dca20a3da10a. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:43:53.685375 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e7620343-392f-4076-a453-e1abf2fdef43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Going to run 1 instances... {{(pid=124551) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:43:53.688594 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e7620343-392f-4076-a453-e1abf2fdef43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcb2be6-02db-4853-a8d6-6478a75f26a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:43:53.745590 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-304f0869-2a59-405c-9515-6dd7eb0ccdae tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:43:53.745590 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-304f0869-2a59-405c-9515-6dd7eb0ccdae tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:43:53.745590 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-304f0869-2a59-405c-9515-6dd7eb0ccdae tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:43:53.745590 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-304f0869-2a59-405c-9515-6dd7eb0ccdae tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:43:53.755036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-304f0869-2a59-405c-9515-6dd7eb0ccdae tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:43:53.796518 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-304f0869-2a59-405c-9515-6dd7eb0ccdae tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:53.797932 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-304f0869-2a59-405c-9515-6dd7eb0ccdae tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:53.800075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-304f0869-2a59-405c-9515-6dd7eb0ccdae tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:53.803924 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-304f0869-2a59-405c-9515-6dd7eb0ccdae tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:53.839588 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-304f0869-2a59-405c-9515-6dd7eb0ccdae tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Getting quotas for project 7153c09b2d0b4805ad0360afb7ecd3ca. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:43:53.860959 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-304f0869-2a59-405c-9515-6dd7eb0ccdae tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Getting quotas for user 2d0d5723417d4b60bc51e47f28d09902 and project 7153c09b2d0b4805ad0360afb7ecd3ca. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:43:53.878672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e7620343-392f-4076-a453-e1abf2fdef43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.101273 Jun 16 19:43:53.879562 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 8/21] 10.222.0.36 () {62 vars in 1187 bytes} [Thu Jun 16 19:43:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 2106 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 19:43:53.893308 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-241999ee-01f6-4356-89ea-71da8b57ccc0 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:53.897297 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-241999ee-01f6-4356-89ea-71da8b57ccc0 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:53.899731 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-304f0869-2a59-405c-9515-6dd7eb0ccdae tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:43:53.909375 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-304f0869-2a59-405c-9515-6dd7eb0ccdae tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcb2be6-02db-4853-a8d6-6478a75f26a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:43:54.015876 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-241999ee-01f6-4356-89ea-71da8b57ccc0 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:54.026044 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-241999ee-01f6-4356-89ea-71da8b57ccc0 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1215 microversion: 2.1 time: 0.142552 Jun 16 19:43:54.029989 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 9/22] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:53 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1215 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:54.041276 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-95755a2c-d62c-4002-9a55-ee3819b19514 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1699892503", "imageRef": "9fcb2be6-02db-4853-a8d6-6478a75f26a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "521c8502-275d-4cd0-b45c-aec01d2fbcf4"}], "security_groups": [{"name": "tempest-securitygroup--1281951907"}], "key_name": "tempest-keypair-227914864", "user_data": "}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:43:54.190296 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-304f0869-2a59-405c-9515-6dd7eb0ccdae tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.091328 Jun 16 19:43:54.190942 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 14/23] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:43:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 3093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:43:54.197650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6ff1c8d0-d13b-49da-b206-664f98ca869a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:54.202231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6ff1c8d0-d13b-49da-b206-664f98ca869a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:54.257296 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.network.neutron [None req-95755a2c-d62c-4002-9a55-ee3819b19514 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] validate_networks() for [('521c8502-275d-4cd0-b45c-aec01d2fbcf4', None, None, None, None, None)] {{(pid=124551) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:43:54.423909 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6ff1c8d0-d13b-49da-b206-664f98ca869a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:54.470642 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6ff1c8d0-d13b-49da-b206-664f98ca869a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:54.478586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6ff1c8d0-d13b-49da-b206-664f98ca869a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:54.482340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6ff1c8d0-d13b-49da-b206-664f98ca869a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1280 microversion: 2.20 time: 0.290094 Jun 16 19:43:54.483241 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 15/24] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:43:54 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1280 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:43:54.504786 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c29e57de-f35a-48d9-a2b2-6737b0e0ae38 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:54.505423 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c29e57de-f35a-48d9-a2b2-6737b0e0ae38 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:54.690514 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c29e57de-f35a-48d9-a2b2-6737b0e0ae38 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:54.701734 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c29e57de-f35a-48d9-a2b2-6737b0e0ae38 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1221 microversion: 2.1 time: 0.217256 Jun 16 19:43:54.705428 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 16/25] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:54 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1221 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:55.045208 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cf8ff1b5-af06-4c8a-8ead-d2bd435252c8 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:55.045834 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-cf8ff1b5-af06-4c8a-8ead-d2bd435252c8 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:55.053580 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cf8ff1b5-af06-4c8a-8ead-d2bd435252c8 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:55.055105 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cf8ff1b5-af06-4c8a-8ead-d2bd435252c8 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:55.056141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cf8ff1b5-af06-4c8a-8ead-d2bd435252c8 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:55.056785 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cf8ff1b5-af06-4c8a-8ead-d2bd435252c8 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:55.327118 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-95755a2c-d62c-4002-9a55-ee3819b19514 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Flavor limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:43:55.327713 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-95755a2c-d62c-4002-9a55-ee3819b19514 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Image limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:43:55.328003 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-95755a2c-d62c-4002-9a55-ee3819b19514 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Flavor pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:43:55.328585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-95755a2c-d62c-4002-9a55-ee3819b19514 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Image pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:43:55.329307 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-95755a2c-d62c-4002-9a55-ee3819b19514 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:43:55.348010 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-95755a2c-d62c-4002-9a55-ee3819b19514 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:55.348471 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-95755a2c-d62c-4002-9a55-ee3819b19514 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:55.354209 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-95755a2c-d62c-4002-9a55-ee3819b19514 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:55.354798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-95755a2c-d62c-4002-9a55-ee3819b19514 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:55.380688 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-95755a2c-d62c-4002-9a55-ee3819b19514 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Getting quotas for project 47a4ab888dd74218ab5d7812ad095371. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:43:55.384825 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-95755a2c-d62c-4002-9a55-ee3819b19514 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Getting quotas for user 4df05cbf303c4524a665b429f240a17a and project 47a4ab888dd74218ab5d7812ad095371. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:43:55.415462 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cf8ff1b5-af06-4c8a-8ead-d2bd435252c8 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:55.426981 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-95755a2c-d62c-4002-9a55-ee3819b19514 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Going to run 1 instances... {{(pid=124551) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:43:55.437705 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-95755a2c-d62c-4002-9a55-ee3819b19514 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcb2be6-02db-4853-a8d6-6478a75f26a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:43:55.447149 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cf8ff1b5-af06-4c8a-8ead-d2bd435252c8 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1219 microversion: 2.1 time: 0.403709 Jun 16 19:43:55.449230 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 17/26] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:55 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1219 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:43:55.473242 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fc9fc1a8-682c-4f55-8ea7-c3a1e8979781 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-482790844", "imageRef": "9fcb2be6-02db-4853-a8d6-6478a75f26a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:43:55.575480 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-fc9fc1a8-682c-4f55-8ea7-c3a1e8979781 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] validate_networks() for [('4c1db9f4-758f-4b75-b0a9-1383e34ed987', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:43:55.658016 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-95755a2c-d62c-4002-9a55-ee3819b19514 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.626370 Jun 16 19:43:55.660550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 10/27] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:43:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:43:55.676009 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-526f7afe-cf23-43f4-ae8e-e8672dcea2a4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:55.676828 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-526f7afe-cf23-43f4-ae8e-e8672dcea2a4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:56.093884 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-526f7afe-cf23-43f4-ae8e-e8672dcea2a4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:56.114968 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-526f7afe-cf23-43f4-ae8e-e8672dcea2a4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:56.147372 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-526f7afe-cf23-43f4-ae8e-e8672dcea2a4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:56.149831 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-526f7afe-cf23-43f4-ae8e-e8672dcea2a4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1280 microversion: 2.20 time: 0.487905 Jun 16 19:43:56.157406 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 11/28] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:43:55 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1280 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:43:56.180577 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d695aa98-c071-445d-872f-d6932eab480d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:56.188536 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d695aa98-c071-445d-872f-d6932eab480d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:56.431303 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d695aa98-c071-445d-872f-d6932eab480d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:56.463569 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d695aa98-c071-445d-872f-d6932eab480d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1241 microversion: 2.1 time: 0.301561 Jun 16 19:43:56.467337 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 12/29] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:56 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1241 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:56.478749 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-fb40285b-92ab-4eb7-af93-10838f51893a tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:56.481716 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-fb40285b-92ab-4eb7-af93-10838f51893a tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:56.514758 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fb40285b-92ab-4eb7-af93-10838f51893a tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:56.520635 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fb40285b-92ab-4eb7-af93-10838f51893a tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:56.524386 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fb40285b-92ab-4eb7-af93-10838f51893a tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:56.525843 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fb40285b-92ab-4eb7-af93-10838f51893a tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:56.539855 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-fc9fc1a8-682c-4f55-8ea7-c3a1e8979781 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:43:56.540594 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-fc9fc1a8-682c-4f55-8ea7-c3a1e8979781 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:43:56.541041 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-fc9fc1a8-682c-4f55-8ea7-c3a1e8979781 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:43:56.541522 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-fc9fc1a8-682c-4f55-8ea7-c3a1e8979781 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:43:56.541998 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-fc9fc1a8-682c-4f55-8ea7-c3a1e8979781 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:43:56.554934 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fc9fc1a8-682c-4f55-8ea7-c3a1e8979781 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:56.555408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fc9fc1a8-682c-4f55-8ea7-c3a1e8979781 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:56.556417 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fc9fc1a8-682c-4f55-8ea7-c3a1e8979781 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:56.557009 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fc9fc1a8-682c-4f55-8ea7-c3a1e8979781 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:56.596637 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-fc9fc1a8-682c-4f55-8ea7-c3a1e8979781 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Getting quotas for project 7153c09b2d0b4805ad0360afb7ecd3ca. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:43:56.617242 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-fc9fc1a8-682c-4f55-8ea7-c3a1e8979781 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Getting quotas for user 2d0d5723417d4b60bc51e47f28d09902 and project 7153c09b2d0b4805ad0360afb7ecd3ca. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:43:56.633237 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fc9fc1a8-682c-4f55-8ea7-c3a1e8979781 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:43:56.635528 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fc9fc1a8-682c-4f55-8ea7-c3a1e8979781 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcb2be6-02db-4853-a8d6-6478a75f26a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:43:56.966618 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fc9fc1a8-682c-4f55-8ea7-c3a1e8979781 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.516066 Jun 16 19:43:56.967915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-fb40285b-92ab-4eb7-af93-10838f51893a tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:56.979514 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 18/30] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:43:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:43:56.993170 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-fb40285b-92ab-4eb7-af93-10838f51893a tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1267 microversion: 2.1 time: 0.520846 Jun 16 19:43:56.994121 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 13/31] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:56 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1267 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:57.001372 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-dcfdf81e-0802-479b-9bf9-6b9e7e5b34b3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:57.002270 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-dcfdf81e-0802-479b-9bf9-6b9e7e5b34b3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:57.171905 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-dcfdf81e-0802-479b-9bf9-6b9e7e5b34b3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:57.179952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d7a87127-c57e-4032-a4c5-875c203cc412 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:57.180857 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d7a87127-c57e-4032-a4c5-875c203cc412 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:57.188306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-dcfdf81e-0802-479b-9bf9-6b9e7e5b34b3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1221 microversion: 2.1 time: 0.207465 Jun 16 19:43:57.209583 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 19/32] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:56 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1221 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:57.212038 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d7a87127-c57e-4032-a4c5-875c203cc412 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:57.212948 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d7a87127-c57e-4032-a4c5-875c203cc412 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:57.214224 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d7a87127-c57e-4032-a4c5-875c203cc412 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:57.215022 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d7a87127-c57e-4032-a4c5-875c203cc412 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:57.482960 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-311f3021-bf63-44ba-a84a-135481fb1f99 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:57.484403 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-311f3021-bf63-44ba-a84a-135481fb1f99 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:57.631437 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-311f3021-bf63-44ba-a84a-135481fb1f99 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:57.646855 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-311f3021-bf63-44ba-a84a-135481fb1f99 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1241 microversion: 2.1 time: 0.168273 Jun 16 19:43:57.657787 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 20/33] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:57 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1241 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:43:57.819502 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d7a87127-c57e-4032-a4c5-875c203cc412 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:57.833669 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d7a87127-c57e-4032-a4c5-875c203cc412 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:57.836553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d7a87127-c57e-4032-a4c5-875c203cc412 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:57.837877 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d7a87127-c57e-4032-a4c5-875c203cc412 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1284 microversion: 2.20 time: 0.663697 Jun 16 19:43:57.851110 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 14/34] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:43:57 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1284 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:43:58.022221 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a1e720a3-1120-49d7-9c77-d0fb5695b7e5 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:58.023141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a1e720a3-1120-49d7-9c77-d0fb5695b7e5 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:58.048328 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a1e720a3-1120-49d7-9c77-d0fb5695b7e5 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:58.048791 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a1e720a3-1120-49d7-9c77-d0fb5695b7e5 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:58.049555 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a1e720a3-1120-49d7-9c77-d0fb5695b7e5 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:58.050000 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a1e720a3-1120-49d7-9c77-d0fb5695b7e5 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:58.205464 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3969b94a-5bce-4353-94a1-f80f9a5c5e69 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:58.208462 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-3969b94a-5bce-4353-94a1-f80f9a5c5e69 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:58.271368 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a1e720a3-1120-49d7-9c77-d0fb5695b7e5 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:58.275694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a1e720a3-1120-49d7-9c77-d0fb5695b7e5 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1273 microversion: 2.1 time: 0.263517 Jun 16 19:43:58.276854 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 21/35] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:58 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1273 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:58.333138 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3969b94a-5bce-4353-94a1-f80f9a5c5e69 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:58.340882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-3969b94a-5bce-4353-94a1-f80f9a5c5e69 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1221 microversion: 2.1 time: 0.139064 Jun 16 19:43:58.342635 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 15/36] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:58 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1221 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:43:58.673332 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-71ec52c3-81fd-458e-9c9f-c546efd31ef8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:58.674138 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-71ec52c3-81fd-458e-9c9f-c546efd31ef8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:58.681870 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-71ec52c3-81fd-458e-9c9f-c546efd31ef8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:58.688067 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-71ec52c3-81fd-458e-9c9f-c546efd31ef8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:58.689020 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-71ec52c3-81fd-458e-9c9f-c546efd31ef8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:58.689914 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-71ec52c3-81fd-458e-9c9f-c546efd31ef8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:58.798976 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-71ec52c3-81fd-458e-9c9f-c546efd31ef8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:58.824643 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-71ec52c3-81fd-458e-9c9f-c546efd31ef8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1237 microversion: 2.1 time: 0.153179 Jun 16 19:43:58.826623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 22/37] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:58 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1237 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:43:58.858774 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-ed65d0e7-1774-4b00-b610-ba9cc18b3de5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:58.859427 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-ed65d0e7-1774-4b00-b610-ba9cc18b3de5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:58.867006 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ed65d0e7-1774-4b00-b610-ba9cc18b3de5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:58.867542 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ed65d0e7-1774-4b00-b610-ba9cc18b3de5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:58.868527 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ed65d0e7-1774-4b00-b610-ba9cc18b3de5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:58.869170 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ed65d0e7-1774-4b00-b610-ba9cc18b3de5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:59.086142 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ed65d0e7-1774-4b00-b610-ba9cc18b3de5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:59.097948 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ed65d0e7-1774-4b00-b610-ba9cc18b3de5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:59.099675 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ed65d0e7-1774-4b00-b610-ba9cc18b3de5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:59.100977 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-ed65d0e7-1774-4b00-b610-ba9cc18b3de5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1332 microversion: 2.20 time: 0.248379 Jun 16 19:43:59.101804 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 16/38] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:43:58 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1332 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:43:59.298133 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f9c6f474-cff3-4285-ad69-0790069cf1b4 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:59.298872 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f9c6f474-cff3-4285-ad69-0790069cf1b4 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:59.310551 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f9c6f474-cff3-4285-ad69-0790069cf1b4 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:59.311029 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f9c6f474-cff3-4285-ad69-0790069cf1b4 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:59.313872 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f9c6f474-cff3-4285-ad69-0790069cf1b4 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:59.315577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f9c6f474-cff3-4285-ad69-0790069cf1b4 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:59.360795 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3f3d7daf-ce3e-47f9-a6b8-c8a3fe27ba14 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:59.361553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-3f3d7daf-ce3e-47f9-a6b8-c8a3fe27ba14 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:59.398978 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3f3d7daf-ce3e-47f9-a6b8-c8a3fe27ba14 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:59.398978 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3f3d7daf-ce3e-47f9-a6b8-c8a3fe27ba14 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:59.398978 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3f3d7daf-ce3e-47f9-a6b8-c8a3fe27ba14 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:59.398978 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3f3d7daf-ce3e-47f9-a6b8-c8a3fe27ba14 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:59.535538 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3f3d7daf-ce3e-47f9-a6b8-c8a3fe27ba14 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:43:59.548211 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-3f3d7daf-ce3e-47f9-a6b8-c8a3fe27ba14 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1225 microversion: 2.1 time: 0.194004 Jun 16 19:43:59.549394 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 17/39] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:59 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1225 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:43:59.848977 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d30dd3c1-b2d6-44ea-acc9-385d25b5c732 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:43:59.851757 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d30dd3c1-b2d6-44ea-acc9-385d25b5c732 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:43:59.877521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d30dd3c1-b2d6-44ea-acc9-385d25b5c732 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:59.879059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d30dd3c1-b2d6-44ea-acc9-385d25b5c732 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:59.881086 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d30dd3c1-b2d6-44ea-acc9-385d25b5c732 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:43:59.882055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d30dd3c1-b2d6-44ea-acc9-385d25b5c732 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:43:59.986961 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f9c6f474-cff3-4285-ad69-0790069cf1b4 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:00.017967 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f9c6f474-cff3-4285-ad69-0790069cf1b4 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.728257 Jun 16 19:44:00.031165 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 23/40] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:59 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:00.093220 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d30dd3c1-b2d6-44ea-acc9-385d25b5c732 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:00.108511 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d30dd3c1-b2d6-44ea-acc9-385d25b5c732 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1293 microversion: 2.1 time: 0.268625 Jun 16 19:44:00.121678 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-15723eac-939d-4f3b-8850-7533eb9a06d3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:00.123241 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-15723eac-939d-4f3b-8850-7533eb9a06d3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:00.135526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-15723eac-939d-4f3b-8850-7533eb9a06d3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:00.136281 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-15723eac-939d-4f3b-8850-7533eb9a06d3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:00.138782 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-15723eac-939d-4f3b-8850-7533eb9a06d3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:00.141878 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-15723eac-939d-4f3b-8850-7533eb9a06d3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:00.142218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 18/41] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:43:59 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1293 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:00.565943 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-955a01b1-2b78-4940-b360-d95c46418bbb tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:00.566566 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-955a01b1-2b78-4940-b360-d95c46418bbb tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:00.579600 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-955a01b1-2b78-4940-b360-d95c46418bbb tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:00.580054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-955a01b1-2b78-4940-b360-d95c46418bbb tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:00.581849 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-955a01b1-2b78-4940-b360-d95c46418bbb tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:00.581849 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-955a01b1-2b78-4940-b360-d95c46418bbb tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:00.969265 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-15723eac-939d-4f3b-8850-7533eb9a06d3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:00.981229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-15723eac-939d-4f3b-8850-7533eb9a06d3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:01.002277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-15723eac-939d-4f3b-8850-7533eb9a06d3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:01.008895 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-15723eac-939d-4f3b-8850-7533eb9a06d3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1338 microversion: 2.20 time: 0.891143 Jun 16 19:44:01.014807 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 24/42] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:00 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1338 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:44:01.040281 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-277d47b7-8a2f-4197-9a7c-4ea6ebdeeb5d tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:01.047069 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-277d47b7-8a2f-4197-9a7c-4ea6ebdeeb5d tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:01.082507 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-277d47b7-8a2f-4197-9a7c-4ea6ebdeeb5d tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:01.347978 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-277d47b7-8a2f-4197-9a7c-4ea6ebdeeb5d tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:01.347978 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-277d47b7-8a2f-4197-9a7c-4ea6ebdeeb5d tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:01.347978 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-277d47b7-8a2f-4197-9a7c-4ea6ebdeeb5d tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:01.349114 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-955a01b1-2b78-4940-b360-d95c46418bbb tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:01.349114 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-955a01b1-2b78-4940-b360-d95c46418bbb tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1273 microversion: 2.1 time: 0.644197 Jun 16 19:44:01.349114 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 19/43] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:00 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1273 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:01.349114 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bbac67f3-7759-4e12-9fa1-b1017eaf8461 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:01.350242 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-bbac67f3-7759-4e12-9fa1-b1017eaf8461 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:01.350242 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bbac67f3-7759-4e12-9fa1-b1017eaf8461 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:01.350242 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bbac67f3-7759-4e12-9fa1-b1017eaf8461 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:01.350242 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bbac67f3-7759-4e12-9fa1-b1017eaf8461 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:01.351627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bbac67f3-7759-4e12-9fa1-b1017eaf8461 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:01.469738 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-bbac67f3-7759-4e12-9fa1-b1017eaf8461 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:01.469738 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-bbac67f3-7759-4e12-9fa1-b1017eaf8461 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1311 microversion: 2.1 time: 0.204294 Jun 16 19:44:01.469738 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 20/44] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:01 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1311 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:01.522983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-277d47b7-8a2f-4197-9a7c-4ea6ebdeeb5d tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:01.547115 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-277d47b7-8a2f-4197-9a7c-4ea6ebdeeb5d tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.516064 Jun 16 19:44:01.551739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 25/45] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:01 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:02.046394 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-92090056-52aa-4270-8793-ad7b7da7dcd4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:02.063483 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-92090056-52aa-4270-8793-ad7b7da7dcd4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:02.098192 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:02.105660 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-92090056-52aa-4270-8793-ad7b7da7dcd4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:02.112367 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-92090056-52aa-4270-8793-ad7b7da7dcd4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:02.114754 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-92090056-52aa-4270-8793-ad7b7da7dcd4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:02.134578 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-92090056-52aa-4270-8793-ad7b7da7dcd4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:02.343946 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6d81218a-336b-471d-becb-80c9c9b3a426 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:02.344734 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6d81218a-336b-471d-becb-80c9c9b3a426 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:02.364755 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6d81218a-336b-471d-becb-80c9c9b3a426 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:02.365155 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6d81218a-336b-471d-becb-80c9c9b3a426 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:02.377444 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6d81218a-336b-471d-becb-80c9c9b3a426 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:02.378199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6d81218a-336b-471d-becb-80c9c9b3a426 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:02.814735 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6d81218a-336b-471d-becb-80c9c9b3a426 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:02.829623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6d81218a-336b-471d-becb-80c9c9b3a426 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1291 microversion: 2.1 time: 0.492626 Jun 16 19:44:02.830533 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 26/46] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:02 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1291 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:02.858032 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0ea72e66-6324-419e-bb1b-997eddefd7b8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:02.861155 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0ea72e66-6324-419e-bb1b-997eddefd7b8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:02.885779 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0ea72e66-6324-419e-bb1b-997eddefd7b8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:02.885779 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0ea72e66-6324-419e-bb1b-997eddefd7b8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:02.885779 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0ea72e66-6324-419e-bb1b-997eddefd7b8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:02.885779 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0ea72e66-6324-419e-bb1b-997eddefd7b8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:02.956122 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-92090056-52aa-4270-8793-ad7b7da7dcd4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:02.978972 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-92090056-52aa-4270-8793-ad7b7da7dcd4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:02.983578 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-92090056-52aa-4270-8793-ad7b7da7dcd4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:02.996353 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-92090056-52aa-4270-8793-ad7b7da7dcd4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1338 microversion: 2.20 time: 0.956451 Jun 16 19:44:02.998705 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 21/47] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:02 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1338 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:03.005154 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-4ab21d19-62f7-4ad5-8e3c-f5da953b19c9 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:03.006121 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-4ab21d19-62f7-4ad5-8e3c-f5da953b19c9 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:03.013429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4ab21d19-62f7-4ad5-8e3c-f5da953b19c9 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:03.014258 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4ab21d19-62f7-4ad5-8e3c-f5da953b19c9 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:03.016099 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4ab21d19-62f7-4ad5-8e3c-f5da953b19c9 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:03.016818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4ab21d19-62f7-4ad5-8e3c-f5da953b19c9 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:03.290073 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0ea72e66-6324-419e-bb1b-997eddefd7b8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:03.304043 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0ea72e66-6324-419e-bb1b-997eddefd7b8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1299 microversion: 2.1 time: 0.468602 Jun 16 19:44:03.307812 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 27/48] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:02 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1299 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:03.357556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-4ab21d19-62f7-4ad5-8e3c-f5da953b19c9 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:03.379797 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-4ab21d19-62f7-4ad5-8e3c-f5da953b19c9 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.373666 Jun 16 19:44:03.379797 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 22/49] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:02 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:03.847438 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a3a9d6dd-a89d-4bbf-aa22-689d1f54c713 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:03.848104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a3a9d6dd-a89d-4bbf-aa22-689d1f54c713 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:03.857483 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a3a9d6dd-a89d-4bbf-aa22-689d1f54c713 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:03.860790 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a3a9d6dd-a89d-4bbf-aa22-689d1f54c713 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:03.861795 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a3a9d6dd-a89d-4bbf-aa22-689d1f54c713 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:03.865205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a3a9d6dd-a89d-4bbf-aa22-689d1f54c713 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:04.004262 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-30ca7230-3d55-4a38-bed5-53edd9ebb3e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:04.004970 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-30ca7230-3d55-4a38-bed5-53edd9ebb3e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:04.021089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-30ca7230-3d55-4a38-bed5-53edd9ebb3e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:04.025879 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-30ca7230-3d55-4a38-bed5-53edd9ebb3e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:04.026959 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-30ca7230-3d55-4a38-bed5-53edd9ebb3e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:04.035175 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-30ca7230-3d55-4a38-bed5-53edd9ebb3e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:04.313256 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a3a9d6dd-a89d-4bbf-aa22-689d1f54c713 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:04.327052 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a3a9d6dd-a89d-4bbf-aa22-689d1f54c713 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1279 microversion: 2.1 time: 0.483395 Jun 16 19:44:04.333206 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 28/50] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:03 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1279 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:04.665172 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-30ca7230-3d55-4a38-bed5-53edd9ebb3e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:04.674603 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-30ca7230-3d55-4a38-bed5-53edd9ebb3e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:04.685028 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-30ca7230-3d55-4a38-bed5-53edd9ebb3e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:04.686205 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-30ca7230-3d55-4a38-bed5-53edd9ebb3e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.686066 Jun 16 19:44:04.701509 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 23/51] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:03 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:04.706396 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-beadfc08-b9c5-4a50-8a12-faf8dd672db6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:04.707048 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-beadfc08-b9c5-4a50-8a12-faf8dd672db6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:04.741337 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-beadfc08-b9c5-4a50-8a12-faf8dd672db6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:04.743589 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-beadfc08-b9c5-4a50-8a12-faf8dd672db6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:04.745226 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-beadfc08-b9c5-4a50-8a12-faf8dd672db6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:04.747076 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-beadfc08-b9c5-4a50-8a12-faf8dd672db6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:05.010105 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-fabc837d-97aa-4f12-b65f-6f8b31a2c6c3 req-5566e61b-aa65-48ef-a137-b44e2918f764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7105897-838f-4c95-ae60-85519aedc5f4", "tag": "9e5ad711-50b7-4712-b146-3a4866c32613"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:05.036653 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-fabc837d-97aa-4f12-b65f-6f8b31a2c6c3 req-5566e61b-aa65-48ef-a137-b44e2918f764 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:05.037079 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-fabc837d-97aa-4f12-b65f-6f8b31a2c6c3 req-5566e61b-aa65-48ef-a137-b44e2918f764 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:05.060170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-fabc837d-97aa-4f12-b65f-6f8b31a2c6c3 req-5566e61b-aa65-48ef-a137-b44e2918f764 service nova] Creating event network-changed:9e5ad711-50b7-4712-b146-3a4866c32613 for instance f7105897-838f-4c95-ae60-85519aedc5f4 on hv-cinder-84617 Jun 16 19:44:05.061032 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-fabc837d-97aa-4f12-b65f-6f8b31a2c6c3 req-5566e61b-aa65-48ef-a137-b44e2918f764 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124550) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 19:44:05.062330 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-294421f7-154a-451c-9fba-5716e5434a1a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:05.062958 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-294421f7-154a-451c-9fba-5716e5434a1a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:05.063891 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-294421f7-154a-451c-9fba-5716e5434a1a None None] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:05.064482 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-294421f7-154a-451c-9fba-5716e5434a1a None None] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:05.077986 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.compute.rpcapi [None req-294421f7-154a-451c-9fba-5716e5434a1a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 19:44:05.079994 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-294421f7-154a-451c-9fba-5716e5434a1a None None] Releasing lock "compute-rpcapi-router" {{(pid=124550) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 19:44:05.097428 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-294421f7-154a-451c-9fba-5716e5434a1a None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.762801 Jun 16 19:44:05.098072 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 29/52] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:44:05.105203 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6eb1e146-da3b-4646-b707-17f3ef25c01e tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:05.106758 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6eb1e146-da3b-4646-b707-17f3ef25c01e tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:05.115312 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6eb1e146-da3b-4646-b707-17f3ef25c01e tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:05.116565 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6eb1e146-da3b-4646-b707-17f3ef25c01e tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:05.118019 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6eb1e146-da3b-4646-b707-17f3ef25c01e tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:05.118606 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6eb1e146-da3b-4646-b707-17f3ef25c01e tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:05.371471 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=6 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:05.631060 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-beadfc08-b9c5-4a50-8a12-faf8dd672db6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:05.648755 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-beadfc08-b9c5-4a50-8a12-faf8dd672db6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.938157 Jun 16 19:44:05.649878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 24/53] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:04 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:05.654864 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e149d69b-4453-4b16-bc35-20f4ceda7f79 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:05.659210 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e149d69b-4453-4b16-bc35-20f4ceda7f79 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:05.687471 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e149d69b-4453-4b16-bc35-20f4ceda7f79 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:05.690537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e149d69b-4453-4b16-bc35-20f4ceda7f79 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:05.691670 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e149d69b-4453-4b16-bc35-20f4ceda7f79 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:05.692979 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e149d69b-4453-4b16-bc35-20f4ceda7f79 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:05.745095 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6eb1e146-da3b-4646-b707-17f3ef25c01e tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:05.757527 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6eb1e146-da3b-4646-b707-17f3ef25c01e tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.657501 Jun 16 19:44:05.758243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 30/54] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:05 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:05.770553 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5858e50b-dea4-4d3c-8a18-2bb46ac7c910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:05.771427 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5858e50b-dea4-4d3c-8a18-2bb46ac7c910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:05.785269 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5858e50b-dea4-4d3c-8a18-2bb46ac7c910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:05.786044 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5858e50b-dea4-4d3c-8a18-2bb46ac7c910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:05.787064 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5858e50b-dea4-4d3c-8a18-2bb46ac7c910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:05.788855 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5858e50b-dea4-4d3c-8a18-2bb46ac7c910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:05.896990 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e149d69b-4453-4b16-bc35-20f4ceda7f79 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:05.906364 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e149d69b-4453-4b16-bc35-20f4ceda7f79 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1279 microversion: 2.1 time: 0.255025 Jun 16 19:44:05.917372 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 25/55] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:05 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1279 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:06.668718 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8eb3fd82-ba85-49b2-bec3-6f797095e872 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:06.670736 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8eb3fd82-ba85-49b2-bec3-6f797095e872 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:06.688248 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8eb3fd82-ba85-49b2-bec3-6f797095e872 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:06.689713 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8eb3fd82-ba85-49b2-bec3-6f797095e872 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:06.695409 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8eb3fd82-ba85-49b2-bec3-6f797095e872 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:06.696177 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8eb3fd82-ba85-49b2-bec3-6f797095e872 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:06.767968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5858e50b-dea4-4d3c-8a18-2bb46ac7c910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:06.798247 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5858e50b-dea4-4d3c-8a18-2bb46ac7c910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:06.800932 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5858e50b-dea4-4d3c-8a18-2bb46ac7c910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:06.805327 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5858e50b-dea4-4d3c-8a18-2bb46ac7c910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 1.043667 Jun 16 19:44:06.808337 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 31/56] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:05 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:06.813607 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e47f2e66-b686-4bb1-8b39-f57b9eed2ebf tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:06.818766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e47f2e66-b686-4bb1-8b39-f57b9eed2ebf tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:06.854159 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e47f2e66-b686-4bb1-8b39-f57b9eed2ebf tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:06.855008 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e47f2e66-b686-4bb1-8b39-f57b9eed2ebf tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:06.868347 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e47f2e66-b686-4bb1-8b39-f57b9eed2ebf tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:06.870469 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e47f2e66-b686-4bb1-8b39-f57b9eed2ebf tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:07.158127 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8eb3fd82-ba85-49b2-bec3-6f797095e872 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:07.187211 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8eb3fd82-ba85-49b2-bec3-6f797095e872 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.515536 Jun 16 19:44:07.189769 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 26/57] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:06 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:07.202103 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-048cd5a8-7902-4a18-8c40-8b108a004f05 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:07.208557 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-048cd5a8-7902-4a18-8c40-8b108a004f05 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:07.231449 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-048cd5a8-7902-4a18-8c40-8b108a004f05 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:07.247367 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-048cd5a8-7902-4a18-8c40-8b108a004f05 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:07.248961 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-048cd5a8-7902-4a18-8c40-8b108a004f05 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:07.254331 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-048cd5a8-7902-4a18-8c40-8b108a004f05 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:07.635872 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=24 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:07.860067 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-048cd5a8-7902-4a18-8c40-8b108a004f05 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:07.873026 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-048cd5a8-7902-4a18-8c40-8b108a004f05 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.681964 Jun 16 19:44:07.889005 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 27/58] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:07 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:07.925588 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-30f34d5f-3dae-46aa-a41b-e503120dddc5 req-3fcaa313-92d6-44e1-86a3-ea705d910f08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c939c84-1712-4551-a3e3-cf42be4113fe", "tag": "24f9795e-d76d-4b2b-8ac3-7a285df7d774"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:07.938743 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e47f2e66-b686-4bb1-8b39-f57b9eed2ebf tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:07.956500 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-30f34d5f-3dae-46aa-a41b-e503120dddc5 req-3fcaa313-92d6-44e1-86a3-ea705d910f08 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:07.956980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-30f34d5f-3dae-46aa-a41b-e503120dddc5 req-3fcaa313-92d6-44e1-86a3-ea705d910f08 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:07.957510 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e47f2e66-b686-4bb1-8b39-f57b9eed2ebf tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 1.147452 Jun 16 19:44:07.961344 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 32/59] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:06 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:07.969052 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3d05e759-db7e-4aae-91c3-d25c2de15da2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:07.977139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3d05e759-db7e-4aae-91c3-d25c2de15da2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:07.995247 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d05e759-db7e-4aae-91c3-d25c2de15da2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:07.995746 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d05e759-db7e-4aae-91c3-d25c2de15da2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:07.999764 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d05e759-db7e-4aae-91c3-d25c2de15da2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:08.000380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d05e759-db7e-4aae-91c3-d25c2de15da2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:08.008013 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-30f34d5f-3dae-46aa-a41b-e503120dddc5 req-3fcaa313-92d6-44e1-86a3-ea705d910f08 service nova] Creating event network-changed:24f9795e-d76d-4b2b-8ac3-7a285df7d774 for instance 5c939c84-1712-4551-a3e3-cf42be4113fe on hv-cinder-84617 Jun 16 19:44:08.010140 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-30f34d5f-3dae-46aa-a41b-e503120dddc5 req-3fcaa313-92d6-44e1-86a3-ea705d910f08 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124551) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 19:44:08.011707 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-48ea1081-72e6-45be-b770-16e5d07fa5cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:08.013136 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-48ea1081-72e6-45be-b770-16e5d07fa5cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:08.016342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-48ea1081-72e6-45be-b770-16e5d07fa5cc None None] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:08.016949 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-48ea1081-72e6-45be-b770-16e5d07fa5cc None None] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:08.078415 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.compute.rpcapi [None req-48ea1081-72e6-45be-b770-16e5d07fa5cc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 19:44:08.088394 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-48ea1081-72e6-45be-b770-16e5d07fa5cc None None] Releasing lock "compute-rpcapi-router" {{(pid=124551) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 19:44:08.127012 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-48ea1081-72e6-45be-b770-16e5d07fa5cc None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232060 Jun 16 19:44:08.127573 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 28/60] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:44:08.231970 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-77b2f1b9-1f12-427d-8d27-ae00c6702c94 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:08.240496 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-77b2f1b9-1f12-427d-8d27-ae00c6702c94 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:08.297996 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-77b2f1b9-1f12-427d-8d27-ae00c6702c94 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:08.306683 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-77b2f1b9-1f12-427d-8d27-ae00c6702c94 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:08.312786 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-77b2f1b9-1f12-427d-8d27-ae00c6702c94 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:08.315567 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-77b2f1b9-1f12-427d-8d27-ae00c6702c94 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:08.370413 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=32 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:08.798695 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-77b2f1b9-1f12-427d-8d27-ae00c6702c94 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:08.804757 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:08.812636 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-77b2f1b9-1f12-427d-8d27-ae00c6702c94 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.610987 Jun 16 19:44:08.823874 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 29/61] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:08 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:08.907711 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-886d294e-75dd-42f4-9ae7-a9f594daa53b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:08.909365 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-886d294e-75dd-42f4-9ae7-a9f594daa53b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:08.918353 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-886d294e-75dd-42f4-9ae7-a9f594daa53b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:08.921552 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-886d294e-75dd-42f4-9ae7-a9f594daa53b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:08.923705 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-886d294e-75dd-42f4-9ae7-a9f594daa53b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:08.926062 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-886d294e-75dd-42f4-9ae7-a9f594daa53b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:09.212341 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3d05e759-db7e-4aae-91c3-d25c2de15da2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:09.232861 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-886d294e-75dd-42f4-9ae7-a9f594daa53b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:09.241418 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3d05e759-db7e-4aae-91c3-d25c2de15da2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:09.243921 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-886d294e-75dd-42f4-9ae7-a9f594daa53b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.346841 Jun 16 19:44:09.245342 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3d05e759-db7e-4aae-91c3-d25c2de15da2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:09.247669 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 30/62] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:08 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:09.256269 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3d05e759-db7e-4aae-91c3-d25c2de15da2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 1.286651 Jun 16 19:44:09.256269 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 33/63] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:07 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:09.264084 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cdccf518-cb67-48f3-b876-c12a4587f8f6 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:09.267529 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-cdccf518-cb67-48f3-b876-c12a4587f8f6 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:09.283853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cdccf518-cb67-48f3-b876-c12a4587f8f6 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:09.285642 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cdccf518-cb67-48f3-b876-c12a4587f8f6 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:09.298119 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cdccf518-cb67-48f3-b876-c12a4587f8f6 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:09.298119 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cdccf518-cb67-48f3-b876-c12a4587f8f6 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:09.439919 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-92434b09-6d4d-4b37-a93d-7db36db5905e req-d26c2d20-4cd6-4c88-be72-cfacd673e8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f5ae39-c48a-49e8-81b0-5f1ea289f14f", "tag": "8eabf1a8-e341-4228-bdcf-f29f74159486"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:09.457550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-92434b09-6d4d-4b37-a93d-7db36db5905e req-d26c2d20-4cd6-4c88-be72-cfacd673e8c2 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:09.461334 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-92434b09-6d4d-4b37-a93d-7db36db5905e req-d26c2d20-4cd6-4c88-be72-cfacd673e8c2 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:09.476555 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-92434b09-6d4d-4b37-a93d-7db36db5905e req-d26c2d20-4cd6-4c88-be72-cfacd673e8c2 service nova] Creating event network-changed:8eabf1a8-e341-4228-bdcf-f29f74159486 for instance 02f5ae39-c48a-49e8-81b0-5f1ea289f14f on hv-cinder-84617 Jun 16 19:44:09.483144 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-92434b09-6d4d-4b37-a93d-7db36db5905e req-d26c2d20-4cd6-4c88-be72-cfacd673e8c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224496 Jun 16 19:44:09.486682 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 31/64] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:44:09.831443 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-87cba498-c1ba-4f8d-a3f5-3439fd2536a5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:09.832529 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-87cba498-c1ba-4f8d-a3f5-3439fd2536a5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:09.844056 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-87cba498-c1ba-4f8d-a3f5-3439fd2536a5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:09.844538 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-87cba498-c1ba-4f8d-a3f5-3439fd2536a5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:09.846133 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-87cba498-c1ba-4f8d-a3f5-3439fd2536a5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:09.846579 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-87cba498-c1ba-4f8d-a3f5-3439fd2536a5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:09.905372 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cdccf518-cb67-48f3-b876-c12a4587f8f6 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:09.922483 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cdccf518-cb67-48f3-b876-c12a4587f8f6 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.669253 Jun 16 19:44:09.924364 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 34/65] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:09 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:10.087528 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-87cba498-c1ba-4f8d-a3f5-3439fd2536a5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:10.097670 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-87cba498-c1ba-4f8d-a3f5-3439fd2536a5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.269875 Jun 16 19:44:10.098249 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 32/66] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:09 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:10.266408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-994c1b9f-8510-4e4e-ab24-9b1b42bad34b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:10.268016 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-994c1b9f-8510-4e4e-ab24-9b1b42bad34b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:10.279019 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-994c1b9f-8510-4e4e-ab24-9b1b42bad34b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:10.279271 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-627c8d11-7b73-4eb2-b6de-613d2ec9c104 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:10.286673 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-627c8d11-7b73-4eb2-b6de-613d2ec9c104 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:10.287108 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-994c1b9f-8510-4e4e-ab24-9b1b42bad34b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:10.287108 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-994c1b9f-8510-4e4e-ab24-9b1b42bad34b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:10.287108 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-994c1b9f-8510-4e4e-ab24-9b1b42bad34b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:10.306384 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-627c8d11-7b73-4eb2-b6de-613d2ec9c104 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:10.307670 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-627c8d11-7b73-4eb2-b6de-613d2ec9c104 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:10.308629 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-627c8d11-7b73-4eb2-b6de-613d2ec9c104 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:10.309506 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-627c8d11-7b73-4eb2-b6de-613d2ec9c104 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:10.471331 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-627c8d11-7b73-4eb2-b6de-613d2ec9c104 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:10.484258 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-627c8d11-7b73-4eb2-b6de-613d2ec9c104 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:10.485742 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-627c8d11-7b73-4eb2-b6de-613d2ec9c104 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:10.488387 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-627c8d11-7b73-4eb2-b6de-613d2ec9c104 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.224223 Jun 16 19:44:10.500728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:10 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:44:10.534588 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-994c1b9f-8510-4e4e-ab24-9b1b42bad34b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:10.542745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-994c1b9f-8510-4e4e-ab24-9b1b42bad34b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.282503 Jun 16 19:44:10.543364 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 35/68] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:10 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:10.939262 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-ef805f8c-af2c-4362-9dca-b4014006e165 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:10.939864 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-ef805f8c-af2c-4362-9dca-b4014006e165 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:10.946058 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ef805f8c-af2c-4362-9dca-b4014006e165 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:10.946504 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ef805f8c-af2c-4362-9dca-b4014006e165 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:10.947281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ef805f8c-af2c-4362-9dca-b4014006e165 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:10.947714 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ef805f8c-af2c-4362-9dca-b4014006e165 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:11.076527 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ef805f8c-af2c-4362-9dca-b4014006e165 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:11.084343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-ef805f8c-af2c-4362-9dca-b4014006e165 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.149005 Jun 16 19:44:11.084908 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 34/69] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:10 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:11.115088 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-267ac805-b219-4352-8847-b17630fff8c5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:11.115803 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-267ac805-b219-4352-8847-b17630fff8c5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:11.122300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-267ac805-b219-4352-8847-b17630fff8c5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:11.122752 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-267ac805-b219-4352-8847-b17630fff8c5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:11.123613 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-267ac805-b219-4352-8847-b17630fff8c5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:11.124057 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-267ac805-b219-4352-8847-b17630fff8c5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:11.128103 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:11.253785 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-267ac805-b219-4352-8847-b17630fff8c5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:11.261889 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-267ac805-b219-4352-8847-b17630fff8c5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.150659 Jun 16 19:44:11.262468 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 36/70] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:11 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:11.505638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-89a75b16-f824-4a38-983c-031aeb6a4528 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:11.506249 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-89a75b16-f824-4a38-983c-031aeb6a4528 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:11.512861 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-89a75b16-f824-4a38-983c-031aeb6a4528 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:11.513306 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-89a75b16-f824-4a38-983c-031aeb6a4528 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:11.514063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-89a75b16-f824-4a38-983c-031aeb6a4528 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:11.514513 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-89a75b16-f824-4a38-983c-031aeb6a4528 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:11.559835 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-168321fd-1f6b-46d8-be15-6e6501c09912 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:11.560439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-168321fd-1f6b-46d8-be15-6e6501c09912 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:11.578728 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-168321fd-1f6b-46d8-be15-6e6501c09912 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:11.579509 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-168321fd-1f6b-46d8-be15-6e6501c09912 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:11.580737 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-168321fd-1f6b-46d8-be15-6e6501c09912 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:11.580737 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-168321fd-1f6b-46d8-be15-6e6501c09912 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:11.647298 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-89a75b16-f824-4a38-983c-031aeb6a4528 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:11.656224 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-89a75b16-f824-4a38-983c-031aeb6a4528 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:11.657944 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-89a75b16-f824-4a38-983c-031aeb6a4528 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:11.659159 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-89a75b16-f824-4a38-983c-031aeb6a4528 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.157370 Jun 16 19:44:11.659627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 35/71] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:11 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:11.675363 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-a03104fa-4556-4d0b-9bed-7395eb7aefb8 req-31659f57-dc1c-463d-8bb5-1991712a3c0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f667dde1-232e-4f14-917f-0a749279d6a8", "tag": "ce7582ec-7186-425a-a407-f177022e1f52"}, {"name": "network-changed", "server_uuid": "dbe0ce4c-ef63-4027-aa27-b0d53d1554e0", "tag": "1ca7b559-06c5-424b-bad3-109e063eafe3"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:11.688766 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-a03104fa-4556-4d0b-9bed-7395eb7aefb8 req-31659f57-dc1c-463d-8bb5-1991712a3c0f service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:11.688766 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-a03104fa-4556-4d0b-9bed-7395eb7aefb8 req-31659f57-dc1c-463d-8bb5-1991712a3c0f service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:11.702647 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-a03104fa-4556-4d0b-9bed-7395eb7aefb8 req-31659f57-dc1c-463d-8bb5-1991712a3c0f service nova] Creating event network-changed:ce7582ec-7186-425a-a407-f177022e1f52 for instance f667dde1-232e-4f14-917f-0a749279d6a8 on hv-cinder-84617 Jun 16 19:44:11.702647 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-a03104fa-4556-4d0b-9bed-7395eb7aefb8 req-31659f57-dc1c-463d-8bb5-1991712a3c0f service nova] Creating event network-changed:1ca7b559-06c5-424b-bad3-109e063eafe3 for instance dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 on hv-cinder-84617 Jun 16 19:44:11.709670 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-a03104fa-4556-4d0b-9bed-7395eb7aefb8 req-31659f57-dc1c-463d-8bb5-1991712a3c0f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.043338 Jun 16 19:44:11.710277 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 36/72] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:44:11.745113 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-168321fd-1f6b-46d8-be15-6e6501c09912 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:11.746745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-168321fd-1f6b-46d8-be15-6e6501c09912 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.191411 Jun 16 19:44:11.747338 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 37/73] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:11 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:12.101559 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-05474804-2d9d-4017-91ad-5755ac061467 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:12.102255 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-05474804-2d9d-4017-91ad-5755ac061467 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:12.108440 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05474804-2d9d-4017-91ad-5755ac061467 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:12.108880 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05474804-2d9d-4017-91ad-5755ac061467 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:12.109633 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05474804-2d9d-4017-91ad-5755ac061467 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:12.110067 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05474804-2d9d-4017-91ad-5755ac061467 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:12.251686 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-05474804-2d9d-4017-91ad-5755ac061467 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:12.259313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-05474804-2d9d-4017-91ad-5755ac061467 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.161857 Jun 16 19:44:12.260504 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 37/74] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:12 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:12.278944 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d55fe4d0-9ae0-44e9-bae9-6f6ab8d7e864 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:12.279733 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d55fe4d0-9ae0-44e9-bae9-6f6ab8d7e864 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:12.293558 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d55fe4d0-9ae0-44e9-bae9-6f6ab8d7e864 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:12.294313 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d55fe4d0-9ae0-44e9-bae9-6f6ab8d7e864 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:12.295448 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d55fe4d0-9ae0-44e9-bae9-6f6ab8d7e864 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:12.295973 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d55fe4d0-9ae0-44e9-bae9-6f6ab8d7e864 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:12.455822 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d55fe4d0-9ae0-44e9-bae9-6f6ab8d7e864 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:12.463802 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d55fe4d0-9ae0-44e9-bae9-6f6ab8d7e864 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.188713 Jun 16 19:44:12.464590 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 38/75] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:12 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:12.680475 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a4bc1458-a75a-401a-bc6f-1a54ce36ae84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:12.681124 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a4bc1458-a75a-401a-bc6f-1a54ce36ae84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:12.688561 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a4bc1458-a75a-401a-bc6f-1a54ce36ae84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:12.690703 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a4bc1458-a75a-401a-bc6f-1a54ce36ae84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:12.690703 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a4bc1458-a75a-401a-bc6f-1a54ce36ae84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:12.690703 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a4bc1458-a75a-401a-bc6f-1a54ce36ae84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:12.766735 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-24ac3130-d4e0-4be2-9e38-401cfa894f1e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:12.767938 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-24ac3130-d4e0-4be2-9e38-401cfa894f1e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:12.771334 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:12.775691 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-24ac3130-d4e0-4be2-9e38-401cfa894f1e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:12.776546 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-24ac3130-d4e0-4be2-9e38-401cfa894f1e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:12.777704 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-24ac3130-d4e0-4be2-9e38-401cfa894f1e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:12.778767 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-24ac3130-d4e0-4be2-9e38-401cfa894f1e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:12.911373 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a4bc1458-a75a-401a-bc6f-1a54ce36ae84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:12.930882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a4bc1458-a75a-401a-bc6f-1a54ce36ae84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:12.938339 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a4bc1458-a75a-401a-bc6f-1a54ce36ae84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:12.948345 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a4bc1458-a75a-401a-bc6f-1a54ce36ae84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.273313 Jun 16 19:44:12.948461 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 38/76] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:12 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:13.015344 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-24ac3130-d4e0-4be2-9e38-401cfa894f1e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:13.026026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-24ac3130-d4e0-4be2-9e38-401cfa894f1e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.266296 Jun 16 19:44:13.026968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 39/77] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:12 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:13.279051 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8f073f9e-2d95-45b9-9d96-df1672a1b5e2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:13.280304 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8f073f9e-2d95-45b9-9d96-df1672a1b5e2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:13.292401 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8f073f9e-2d95-45b9-9d96-df1672a1b5e2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:13.293100 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8f073f9e-2d95-45b9-9d96-df1672a1b5e2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:13.294614 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8f073f9e-2d95-45b9-9d96-df1672a1b5e2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:13.296968 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8f073f9e-2d95-45b9-9d96-df1672a1b5e2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:13.452448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8f073f9e-2d95-45b9-9d96-df1672a1b5e2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:13.462614 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8f073f9e-2d95-45b9-9d96-df1672a1b5e2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.189278 Jun 16 19:44:13.464207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 39/78] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:13 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:13.482148 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ed0e2924-130e-4be5-8404-3935bd49f66c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:13.483062 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ed0e2924-130e-4be5-8404-3935bd49f66c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:13.490033 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed0e2924-130e-4be5-8404-3935bd49f66c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:13.490735 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed0e2924-130e-4be5-8404-3935bd49f66c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:13.491799 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed0e2924-130e-4be5-8404-3935bd49f66c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:13.492315 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed0e2924-130e-4be5-8404-3935bd49f66c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:13.689805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ed0e2924-130e-4be5-8404-3935bd49f66c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:13.697852 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ed0e2924-130e-4be5-8404-3935bd49f66c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.220150 Jun 16 19:44:13.698441 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 40/79] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:13 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:13.977228 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f00967b1-5152-411c-97d5-5eb974c6ea1c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:13.977876 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f00967b1-5152-411c-97d5-5eb974c6ea1c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:13.986373 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f00967b1-5152-411c-97d5-5eb974c6ea1c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:13.986373 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f00967b1-5152-411c-97d5-5eb974c6ea1c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:13.986373 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f00967b1-5152-411c-97d5-5eb974c6ea1c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:13.986908 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f00967b1-5152-411c-97d5-5eb974c6ea1c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:14.043613 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3ef5518c-0d93-4eb4-a471-4231591aa533 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:14.046837 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3ef5518c-0d93-4eb4-a471-4231591aa533 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:14.050400 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3ef5518c-0d93-4eb4-a471-4231591aa533 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:14.050852 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3ef5518c-0d93-4eb4-a471-4231591aa533 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:14.051646 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3ef5518c-0d93-4eb4-a471-4231591aa533 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:14.052078 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3ef5518c-0d93-4eb4-a471-4231591aa533 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:14.168308 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f00967b1-5152-411c-97d5-5eb974c6ea1c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:14.179190 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f00967b1-5152-411c-97d5-5eb974c6ea1c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:14.179813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f00967b1-5152-411c-97d5-5eb974c6ea1c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:14.181159 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f00967b1-5152-411c-97d5-5eb974c6ea1c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.217824 Jun 16 19:44:14.182450 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 40/80] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:13 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:14.227116 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3ef5518c-0d93-4eb4-a471-4231591aa533 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:14.237866 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3ef5518c-0d93-4eb4-a471-4231591aa533 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.197923 Jun 16 19:44:14.238430 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 41/81] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:14 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:14.479948 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-4f81cd3a-0f07-4401-92cd-b5110c96f11f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:14.480562 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-4f81cd3a-0f07-4401-92cd-b5110c96f11f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:14.486643 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4f81cd3a-0f07-4401-92cd-b5110c96f11f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:14.487136 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4f81cd3a-0f07-4401-92cd-b5110c96f11f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:14.488012 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4f81cd3a-0f07-4401-92cd-b5110c96f11f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:14.491666 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4f81cd3a-0f07-4401-92cd-b5110c96f11f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:14.851055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-4f81cd3a-0f07-4401-92cd-b5110c96f11f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:14.851055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-4f81cd3a-0f07-4401-92cd-b5110c96f11f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.175988 Jun 16 19:44:14.851055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 41/82] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:14 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:14.852241 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cadfbe33-a026-4132-a54a-ad304f8d67ae tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:14.852241 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-cadfbe33-a026-4132-a54a-ad304f8d67ae tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:14.852241 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cadfbe33-a026-4132-a54a-ad304f8d67ae tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:14.852241 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cadfbe33-a026-4132-a54a-ad304f8d67ae tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:14.852811 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cadfbe33-a026-4132-a54a-ad304f8d67ae tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:14.852811 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cadfbe33-a026-4132-a54a-ad304f8d67ae tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:14.863229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cadfbe33-a026-4132-a54a-ad304f8d67ae tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:14.872902 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cadfbe33-a026-4132-a54a-ad304f8d67ae tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.161811 Jun 16 19:44:14.876472 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 42/83] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:14 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:15.199692 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d12f1c83-f24f-4e2f-af6f-d67effb7f0b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:15.200299 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d12f1c83-f24f-4e2f-af6f-d67effb7f0b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:15.206196 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d12f1c83-f24f-4e2f-af6f-d67effb7f0b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:15.206636 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d12f1c83-f24f-4e2f-af6f-d67effb7f0b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:15.207424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d12f1c83-f24f-4e2f-af6f-d67effb7f0b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:15.207853 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d12f1c83-f24f-4e2f-af6f-d67effb7f0b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:15.256157 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ba43f497-38b3-4ba4-9a32-c1548a9e30bd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:15.256746 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ba43f497-38b3-4ba4-9a32-c1548a9e30bd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:15.258731 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=6 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:15.263435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ba43f497-38b3-4ba4-9a32-c1548a9e30bd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:15.263913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ba43f497-38b3-4ba4-9a32-c1548a9e30bd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:15.264679 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ba43f497-38b3-4ba4-9a32-c1548a9e30bd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:15.265109 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ba43f497-38b3-4ba4-9a32-c1548a9e30bd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:15.340853 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d12f1c83-f24f-4e2f-af6f-d67effb7f0b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:15.349347 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d12f1c83-f24f-4e2f-af6f-d67effb7f0b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:15.351127 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d12f1c83-f24f-4e2f-af6f-d67effb7f0b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:15.352517 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d12f1c83-f24f-4e2f-af6f-d67effb7f0b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.156775 Jun 16 19:44:15.363184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 42/84] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:15 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:15.394335 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ba43f497-38b3-4ba4-9a32-c1548a9e30bd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:15.402663 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ba43f497-38b3-4ba4-9a32-c1548a9e30bd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.150499 Jun 16 19:44:15.407730 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 43/85] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:15 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:15.853080 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e9d540ff-257a-4e81-b722-15c2dc60924b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:15.853689 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e9d540ff-257a-4e81-b722-15c2dc60924b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:15.863272 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e9d540ff-257a-4e81-b722-15c2dc60924b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:15.863760 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e9d540ff-257a-4e81-b722-15c2dc60924b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:15.864512 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e9d540ff-257a-4e81-b722-15c2dc60924b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:15.864940 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e9d540ff-257a-4e81-b722-15c2dc60924b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:15.903428 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b7ab36ac-011e-482c-9f00-4218fc616eee tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:15.904036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b7ab36ac-011e-482c-9f00-4218fc616eee tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:15.910678 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7ab36ac-011e-482c-9f00-4218fc616eee tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:15.925695 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7ab36ac-011e-482c-9f00-4218fc616eee tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:15.925695 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7ab36ac-011e-482c-9f00-4218fc616eee tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:15.925695 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7ab36ac-011e-482c-9f00-4218fc616eee tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:15.991956 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e9d540ff-257a-4e81-b722-15c2dc60924b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:16.000145 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e9d540ff-257a-4e81-b722-15c2dc60924b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.150890 Jun 16 19:44:16.000808 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 43/86] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:15 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:16.042016 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b7ab36ac-011e-482c-9f00-4218fc616eee tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:16.049469 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b7ab36ac-011e-482c-9f00-4218fc616eee tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.149951 Jun 16 19:44:16.052411 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 44/87] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:15 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:16.369740 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-807fdfa9-3e98-4cc1-bba9-fb1e9f811f02 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:16.370341 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-807fdfa9-3e98-4cc1-bba9-fb1e9f811f02 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:16.376924 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-807fdfa9-3e98-4cc1-bba9-fb1e9f811f02 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:16.377359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-807fdfa9-3e98-4cc1-bba9-fb1e9f811f02 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:16.378110 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-807fdfa9-3e98-4cc1-bba9-fb1e9f811f02 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:16.378532 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-807fdfa9-3e98-4cc1-bba9-fb1e9f811f02 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:16.419402 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ffc56d5b-2ee4-4eda-b8e0-68f623a553f9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:16.420021 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ffc56d5b-2ee4-4eda-b8e0-68f623a553f9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:16.426114 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ffc56d5b-2ee4-4eda-b8e0-68f623a553f9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:16.426557 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ffc56d5b-2ee4-4eda-b8e0-68f623a553f9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:16.427348 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ffc56d5b-2ee4-4eda-b8e0-68f623a553f9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:16.427854 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ffc56d5b-2ee4-4eda-b8e0-68f623a553f9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:16.508838 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-807fdfa9-3e98-4cc1-bba9-fb1e9f811f02 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:16.517092 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-807fdfa9-3e98-4cc1-bba9-fb1e9f811f02 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:16.518645 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-807fdfa9-3e98-4cc1-bba9-fb1e9f811f02 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:16.519791 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-807fdfa9-3e98-4cc1-bba9-fb1e9f811f02 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.153961 Jun 16 19:44:16.520341 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 44/88] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:16 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:16.556352 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ffc56d5b-2ee4-4eda-b8e0-68f623a553f9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:16.563792 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ffc56d5b-2ee4-4eda-b8e0-68f623a553f9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.148704 Jun 16 19:44:16.564343 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 45/89] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:16 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:17.017198 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-aad656a4-0413-40b7-9497-6c4183e92af7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:17.017739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-aad656a4-0413-40b7-9497-6c4183e92af7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:17.023776 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-aad656a4-0413-40b7-9497-6c4183e92af7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:17.024266 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-aad656a4-0413-40b7-9497-6c4183e92af7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:17.025012 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-aad656a4-0413-40b7-9497-6c4183e92af7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:17.025473 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-aad656a4-0413-40b7-9497-6c4183e92af7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:17.066879 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c126bedc-d01a-424f-9f70-dc7dab457275 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:17.067519 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c126bedc-d01a-424f-9f70-dc7dab457275 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:17.074298 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c126bedc-d01a-424f-9f70-dc7dab457275 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:17.075207 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c126bedc-d01a-424f-9f70-dc7dab457275 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:17.075871 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c126bedc-d01a-424f-9f70-dc7dab457275 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:17.076308 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c126bedc-d01a-424f-9f70-dc7dab457275 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:17.153763 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-aad656a4-0413-40b7-9497-6c4183e92af7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:17.161464 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-aad656a4-0413-40b7-9497-6c4183e92af7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.148062 Jun 16 19:44:17.162017 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 45/90] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:17 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:17.206996 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c126bedc-d01a-424f-9f70-dc7dab457275 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:17.215205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c126bedc-d01a-424f-9f70-dc7dab457275 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.152161 Jun 16 19:44:17.215763 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 46/91] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:17 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:17.537590 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-82980067-9c4f-4f80-be11-09774c53614b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:17.538195 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-82980067-9c4f-4f80-be11-09774c53614b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:17.544303 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-82980067-9c4f-4f80-be11-09774c53614b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:17.544745 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-82980067-9c4f-4f80-be11-09774c53614b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:17.545569 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-82980067-9c4f-4f80-be11-09774c53614b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:17.546099 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-82980067-9c4f-4f80-be11-09774c53614b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:17.580514 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3438e77b-1599-4079-9eb1-84208e926ce5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:17.581120 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3438e77b-1599-4079-9eb1-84208e926ce5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:17.587561 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3438e77b-1599-4079-9eb1-84208e926ce5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:17.588246 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3438e77b-1599-4079-9eb1-84208e926ce5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:17.589069 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3438e77b-1599-4079-9eb1-84208e926ce5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:17.589534 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3438e77b-1599-4079-9eb1-84208e926ce5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:17.679015 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-82980067-9c4f-4f80-be11-09774c53614b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:17.688191 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-82980067-9c4f-4f80-be11-09774c53614b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:17.689689 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-82980067-9c4f-4f80-be11-09774c53614b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:17.690822 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-82980067-9c4f-4f80-be11-09774c53614b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.157194 Jun 16 19:44:17.691405 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 46/92] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:17 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:17.723997 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3438e77b-1599-4079-9eb1-84208e926ce5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:17.731901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3438e77b-1599-4079-9eb1-84208e926ce5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.155258 Jun 16 19:44:17.732459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 47/93] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:17 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:18.177434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-ad67f670-ba9d-4272-b3ad-eaec183ae17c tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:18.178041 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-ad67f670-ba9d-4272-b3ad-eaec183ae17c tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:18.180792 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=2 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:18.185412 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ad67f670-ba9d-4272-b3ad-eaec183ae17c tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:18.185853 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ad67f670-ba9d-4272-b3ad-eaec183ae17c tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:18.186606 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ad67f670-ba9d-4272-b3ad-eaec183ae17c tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:18.187061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ad67f670-ba9d-4272-b3ad-eaec183ae17c tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:18.233005 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-17faa92e-f631-4320-a37c-a8af83334fa3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:18.233660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-17faa92e-f631-4320-a37c-a8af83334fa3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:18.239962 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-17faa92e-f631-4320-a37c-a8af83334fa3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:18.240399 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-17faa92e-f631-4320-a37c-a8af83334fa3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:18.241153 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-17faa92e-f631-4320-a37c-a8af83334fa3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:18.241580 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-17faa92e-f631-4320-a37c-a8af83334fa3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:18.324551 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ad67f670-ba9d-4272-b3ad-eaec183ae17c tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:18.327985 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:18.332596 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-ad67f670-ba9d-4272-b3ad-eaec183ae17c tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.158948 Jun 16 19:44:18.333160 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 47/94] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:18 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:18.378112 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-17faa92e-f631-4320-a37c-a8af83334fa3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:18.385568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-17faa92e-f631-4320-a37c-a8af83334fa3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.157786 Jun 16 19:44:18.386171 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 48/95] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:18 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:18.708455 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-fd566bb3-1dc1-4440-87a2-79c7137e22b5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:18.713158 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-fd566bb3-1dc1-4440-87a2-79c7137e22b5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:18.715755 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fd566bb3-1dc1-4440-87a2-79c7137e22b5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:18.716195 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fd566bb3-1dc1-4440-87a2-79c7137e22b5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:18.716940 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fd566bb3-1dc1-4440-87a2-79c7137e22b5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:18.717366 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fd566bb3-1dc1-4440-87a2-79c7137e22b5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:18.748140 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ebfeda18-b106-407d-a929-5ef8df43f154 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:18.748869 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ebfeda18-b106-407d-a929-5ef8df43f154 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:18.754878 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebfeda18-b106-407d-a929-5ef8df43f154 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:18.755354 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebfeda18-b106-407d-a929-5ef8df43f154 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:18.756110 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebfeda18-b106-407d-a929-5ef8df43f154 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:18.756544 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebfeda18-b106-407d-a929-5ef8df43f154 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:18.864614 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-fd566bb3-1dc1-4440-87a2-79c7137e22b5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:18.873712 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-fd566bb3-1dc1-4440-87a2-79c7137e22b5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:18.875245 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-fd566bb3-1dc1-4440-87a2-79c7137e22b5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:18.876417 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-fd566bb3-1dc1-4440-87a2-79c7137e22b5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.171977 Jun 16 19:44:18.877017 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 48/96] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:18 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:18.894460 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ebfeda18-b106-407d-a929-5ef8df43f154 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:18.902501 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ebfeda18-b106-407d-a929-5ef8df43f154 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.158163 Jun 16 19:44:18.903094 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 49/97] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:18 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:19.348684 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-17f6e998-e0be-4e9b-a21d-923116ab28a6 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:19.349289 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-17f6e998-e0be-4e9b-a21d-923116ab28a6 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:19.355893 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-17f6e998-e0be-4e9b-a21d-923116ab28a6 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:19.356338 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-17f6e998-e0be-4e9b-a21d-923116ab28a6 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:19.357092 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-17f6e998-e0be-4e9b-a21d-923116ab28a6 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:19.357517 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-17f6e998-e0be-4e9b-a21d-923116ab28a6 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:19.401495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-087526fd-495c-44b0-af03-d54eee35867b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:19.402674 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-087526fd-495c-44b0-af03-d54eee35867b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:19.408683 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-087526fd-495c-44b0-af03-d54eee35867b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:19.409102 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-087526fd-495c-44b0-af03-d54eee35867b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:19.409851 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-087526fd-495c-44b0-af03-d54eee35867b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:19.410280 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-087526fd-495c-44b0-af03-d54eee35867b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:19.483123 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-17f6e998-e0be-4e9b-a21d-923116ab28a6 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:19.490889 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-17f6e998-e0be-4e9b-a21d-923116ab28a6 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.145963 Jun 16 19:44:19.491155 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 49/98] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:19 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:19.548801 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-087526fd-495c-44b0-af03-d54eee35867b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:19.559177 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-087526fd-495c-44b0-af03-d54eee35867b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.161531 Jun 16 19:44:19.559736 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 50/99] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:19 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:19.894657 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1814090d-3161-4c79-8a29-075bb1e2a790 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:19.903106 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-1814090d-3161-4c79-8a29-075bb1e2a790 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:19.903106 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1814090d-3161-4c79-8a29-075bb1e2a790 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:19.903106 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1814090d-3161-4c79-8a29-075bb1e2a790 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:19.903106 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1814090d-3161-4c79-8a29-075bb1e2a790 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:19.903499 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1814090d-3161-4c79-8a29-075bb1e2a790 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:19.919403 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-84e79daa-6c3e-4db4-8f3d-e2aabca22105 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:19.920032 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-84e79daa-6c3e-4db4-8f3d-e2aabca22105 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:19.925944 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84e79daa-6c3e-4db4-8f3d-e2aabca22105 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:19.927056 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84e79daa-6c3e-4db4-8f3d-e2aabca22105 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:19.927831 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84e79daa-6c3e-4db4-8f3d-e2aabca22105 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:19.928267 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84e79daa-6c3e-4db4-8f3d-e2aabca22105 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:20.066683 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1814090d-3161-4c79-8a29-075bb1e2a790 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:20.074247 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-84e79daa-6c3e-4db4-8f3d-e2aabca22105 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:20.075617 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1814090d-3161-4c79-8a29-075bb1e2a790 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:20.077110 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1814090d-3161-4c79-8a29-075bb1e2a790 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:20.078205 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-1814090d-3161-4c79-8a29-075bb1e2a790 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.187818 Jun 16 19:44:20.078748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 50/100] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:19 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:20.081752 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-84e79daa-6c3e-4db4-8f3d-e2aabca22105 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.166724 Jun 16 19:44:20.082310 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 51/101] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:19 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:20.507755 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-086c377a-7520-4886-869f-12bc3c148b09 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:20.532175 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-086c377a-7520-4886-869f-12bc3c148b09 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:20.532175 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-086c377a-7520-4886-869f-12bc3c148b09 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:20.532175 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-086c377a-7520-4886-869f-12bc3c148b09 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:20.532175 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-086c377a-7520-4886-869f-12bc3c148b09 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:20.532542 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-086c377a-7520-4886-869f-12bc3c148b09 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:20.577886 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a20103b3-dbd2-4840-99e7-294a6111c825 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:20.578671 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a20103b3-dbd2-4840-99e7-294a6111c825 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:20.585217 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a20103b3-dbd2-4840-99e7-294a6111c825 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:20.586460 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a20103b3-dbd2-4840-99e7-294a6111c825 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:20.587359 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a20103b3-dbd2-4840-99e7-294a6111c825 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:20.587888 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a20103b3-dbd2-4840-99e7-294a6111c825 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:20.656394 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-086c377a-7520-4886-869f-12bc3c148b09 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:20.664945 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-086c377a-7520-4886-869f-12bc3c148b09 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.160985 Jun 16 19:44:20.665519 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 51/102] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:20 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:20.877009 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a20103b3-dbd2-4840-99e7-294a6111c825 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:20.880548 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:20.884815 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a20103b3-dbd2-4840-99e7-294a6111c825 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.312348 Jun 16 19:44:20.885381 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 52/103] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:20 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:21.095888 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9a73ac28-a0d9-46ec-bf0c-aa767cb0813d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:21.096525 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9a73ac28-a0d9-46ec-bf0c-aa767cb0813d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:21.103729 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b0045b03-bd90-4909-b282-f7e06a38e26b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:21.107330 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b0045b03-bd90-4909-b282-f7e06a38e26b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:21.108939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9a73ac28-a0d9-46ec-bf0c-aa767cb0813d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:21.109403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9a73ac28-a0d9-46ec-bf0c-aa767cb0813d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:21.110334 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9a73ac28-a0d9-46ec-bf0c-aa767cb0813d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:21.110912 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b0045b03-bd90-4909-b282-f7e06a38e26b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:21.111341 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9a73ac28-a0d9-46ec-bf0c-aa767cb0813d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:21.111449 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b0045b03-bd90-4909-b282-f7e06a38e26b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:21.112148 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b0045b03-bd90-4909-b282-f7e06a38e26b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:21.112749 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b0045b03-bd90-4909-b282-f7e06a38e26b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:21.258806 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9a73ac28-a0d9-46ec-bf0c-aa767cb0813d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:21.272107 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9a73ac28-a0d9-46ec-bf0c-aa767cb0813d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:21.273724 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9a73ac28-a0d9-46ec-bf0c-aa767cb0813d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:21.275003 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9a73ac28-a0d9-46ec-bf0c-aa767cb0813d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.182811 Jun 16 19:44:21.275784 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 52/104] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:21 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:21.281463 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b0045b03-bd90-4909-b282-f7e06a38e26b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:21.288935 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b0045b03-bd90-4909-b282-f7e06a38e26b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.188913 Jun 16 19:44:21.289490 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 53/105] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:21 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:21.686029 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6b4ca9f0-87f6-46a5-9bd3-46df054f754b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:21.686638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6b4ca9f0-87f6-46a5-9bd3-46df054f754b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:21.692770 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6b4ca9f0-87f6-46a5-9bd3-46df054f754b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:21.693249 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6b4ca9f0-87f6-46a5-9bd3-46df054f754b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:21.694002 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6b4ca9f0-87f6-46a5-9bd3-46df054f754b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:21.694433 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6b4ca9f0-87f6-46a5-9bd3-46df054f754b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:21.822543 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6b4ca9f0-87f6-46a5-9bd3-46df054f754b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:21.830050 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6b4ca9f0-87f6-46a5-9bd3-46df054f754b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.148390 Jun 16 19:44:21.830613 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 53/106] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:21 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:21.902775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-70f21813-219d-4748-9afd-9df8e3ad9f3b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:21.903524 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-70f21813-219d-4748-9afd-9df8e3ad9f3b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:21.909512 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-70f21813-219d-4748-9afd-9df8e3ad9f3b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:21.909956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-70f21813-219d-4748-9afd-9df8e3ad9f3b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:21.910715 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-70f21813-219d-4748-9afd-9df8e3ad9f3b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:21.911171 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-70f21813-219d-4748-9afd-9df8e3ad9f3b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:22.038025 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-70f21813-219d-4748-9afd-9df8e3ad9f3b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:22.046062 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-70f21813-219d-4748-9afd-9df8e3ad9f3b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.148351 Jun 16 19:44:22.046626 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 54/107] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:21 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:22.292632 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7a6ba178-1251-450e-a96c-c92816ce5915 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:22.293244 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-7a6ba178-1251-450e-a96c-c92816ce5915 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:22.299217 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7a6ba178-1251-450e-a96c-c92816ce5915 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:22.299671 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7a6ba178-1251-450e-a96c-c92816ce5915 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:22.300688 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7a6ba178-1251-450e-a96c-c92816ce5915 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:22.301134 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7a6ba178-1251-450e-a96c-c92816ce5915 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:22.305251 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b3b7e5d6-2994-49a4-972e-212457f1b60f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:22.305862 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b3b7e5d6-2994-49a4-972e-212457f1b60f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:22.311773 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b3b7e5d6-2994-49a4-972e-212457f1b60f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:22.312218 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b3b7e5d6-2994-49a4-972e-212457f1b60f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:22.312975 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b3b7e5d6-2994-49a4-972e-212457f1b60f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:22.313407 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b3b7e5d6-2994-49a4-972e-212457f1b60f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:22.426716 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-7a6ba178-1251-450e-a96c-c92816ce5915 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:22.434765 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-7a6ba178-1251-450e-a96c-c92816ce5915 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:22.436301 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-7a6ba178-1251-450e-a96c-c92816ce5915 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:22.437401 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-7a6ba178-1251-450e-a96c-c92816ce5915 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.148599 Jun 16 19:44:22.437960 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 54/108] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:22 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:22.441458 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b3b7e5d6-2994-49a4-972e-212457f1b60f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:22.449567 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b3b7e5d6-2994-49a4-972e-212457f1b60f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.148183 Jun 16 19:44:22.450108 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 55/109] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:22 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:22.847486 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-30036289-20b4-45c3-83c2-d03e2cb30650 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:22.848128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-30036289-20b4-45c3-83c2-d03e2cb30650 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:22.854042 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-30036289-20b4-45c3-83c2-d03e2cb30650 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:22.855024 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-30036289-20b4-45c3-83c2-d03e2cb30650 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:22.855790 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-30036289-20b4-45c3-83c2-d03e2cb30650 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:22.856214 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-30036289-20b4-45c3-83c2-d03e2cb30650 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:22.985419 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-30036289-20b4-45c3-83c2-d03e2cb30650 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:22.993012 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-30036289-20b4-45c3-83c2-d03e2cb30650 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.149304 Jun 16 19:44:22.993936 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 55/110] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:22 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:23.063195 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-861aad4a-cf36-4a32-9a0c-fc98447ac996 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:23.063798 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-861aad4a-cf36-4a32-9a0c-fc98447ac996 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:23.070024 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-861aad4a-cf36-4a32-9a0c-fc98447ac996 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:23.070461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-861aad4a-cf36-4a32-9a0c-fc98447ac996 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:23.071234 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-861aad4a-cf36-4a32-9a0c-fc98447ac996 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:23.071692 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-861aad4a-cf36-4a32-9a0c-fc98447ac996 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:23.205494 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-861aad4a-cf36-4a32-9a0c-fc98447ac996 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:23.212848 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-861aad4a-cf36-4a32-9a0c-fc98447ac996 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.153528 Jun 16 19:44:23.213408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 56/111] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:23 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:23.455363 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a04ea387-cc23-4ad7-a05e-697636a25980 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:23.455962 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a04ea387-cc23-4ad7-a05e-697636a25980 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:23.462148 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a04ea387-cc23-4ad7-a05e-697636a25980 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:23.466143 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a04ea387-cc23-4ad7-a05e-697636a25980 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:23.466143 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a04ea387-cc23-4ad7-a05e-697636a25980 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:23.466143 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a04ea387-cc23-4ad7-a05e-697636a25980 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:23.466410 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-87333784-16dc-4049-a4ef-62d56e619cc3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:23.466789 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-87333784-16dc-4049-a4ef-62d56e619cc3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:23.472615 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-87333784-16dc-4049-a4ef-62d56e619cc3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:23.473063 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-87333784-16dc-4049-a4ef-62d56e619cc3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:23.473822 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-87333784-16dc-4049-a4ef-62d56e619cc3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:23.474256 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-87333784-16dc-4049-a4ef-62d56e619cc3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:23.594297 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a04ea387-cc23-4ad7-a05e-697636a25980 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:23.602439 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a04ea387-cc23-4ad7-a05e-697636a25980 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:23.603957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a04ea387-cc23-4ad7-a05e-697636a25980 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:23.605103 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a04ea387-cc23-4ad7-a05e-697636a25980 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.153584 Jun 16 19:44:23.605656 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 56/112] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:23 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:23.607633 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-87333784-16dc-4049-a4ef-62d56e619cc3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:23.615006 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-87333784-16dc-4049-a4ef-62d56e619cc3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.153374 Jun 16 19:44:23.615750 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 57/113] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:23 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:24.011310 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b394b4c4-2f5d-458f-9ec0-40fee116c6f1 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:24.011906 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b394b4c4-2f5d-458f-9ec0-40fee116c6f1 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:24.018023 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b394b4c4-2f5d-458f-9ec0-40fee116c6f1 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:24.018406 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b394b4c4-2f5d-458f-9ec0-40fee116c6f1 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:24.019303 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b394b4c4-2f5d-458f-9ec0-40fee116c6f1 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:24.019623 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b394b4c4-2f5d-458f-9ec0-40fee116c6f1 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:24.146310 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b394b4c4-2f5d-458f-9ec0-40fee116c6f1 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:24.154131 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b394b4c4-2f5d-458f-9ec0-40fee116c6f1 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.147288 Jun 16 19:44:24.154693 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 57/114] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:24 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:24.233082 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e9beabb3-f157-4a83-8b38-3e05821afa89 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:24.233082 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e9beabb3-f157-4a83-8b38-3e05821afa89 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:24.236816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e9beabb3-f157-4a83-8b38-3e05821afa89 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:24.237578 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e9beabb3-f157-4a83-8b38-3e05821afa89 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:24.238443 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e9beabb3-f157-4a83-8b38-3e05821afa89 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:24.238877 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e9beabb3-f157-4a83-8b38-3e05821afa89 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:24.366447 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e9beabb3-f157-4a83-8b38-3e05821afa89 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:24.374525 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e9beabb3-f157-4a83-8b38-3e05821afa89 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.149032 Jun 16 19:44:24.375109 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 58/115] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:24 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:24.622799 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-cb45a7cf-3d99-462a-ad97-a9583eedc0b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:24.623342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-cb45a7cf-3d99-462a-ad97-a9583eedc0b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:24.629434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cb45a7cf-3d99-462a-ad97-a9583eedc0b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:24.629884 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cb45a7cf-3d99-462a-ad97-a9583eedc0b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:24.630684 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cb45a7cf-3d99-462a-ad97-a9583eedc0b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:24.631156 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cb45a7cf-3d99-462a-ad97-a9583eedc0b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:24.631489 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f87fe067-3cdd-4f40-9f0e-a63c51f7a6bc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:24.632124 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f87fe067-3cdd-4f40-9f0e-a63c51f7a6bc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:24.638721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f87fe067-3cdd-4f40-9f0e-a63c51f7a6bc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:24.639218 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f87fe067-3cdd-4f40-9f0e-a63c51f7a6bc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:24.639973 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f87fe067-3cdd-4f40-9f0e-a63c51f7a6bc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:24.640397 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f87fe067-3cdd-4f40-9f0e-a63c51f7a6bc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:24.767888 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-cb45a7cf-3d99-462a-ad97-a9583eedc0b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:24.775897 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-cb45a7cf-3d99-462a-ad97-a9583eedc0b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:24.777386 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-cb45a7cf-3d99-462a-ad97-a9583eedc0b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:24.778526 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-cb45a7cf-3d99-462a-ad97-a9583eedc0b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.159689 Jun 16 19:44:24.778825 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f87fe067-3cdd-4f40-9f0e-a63c51f7a6bc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:24.779099 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 58/116] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:24 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:24.786354 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f87fe067-3cdd-4f40-9f0e-a63c51f7a6bc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.158627 Jun 16 19:44:24.787850 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 59/117] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:24 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:25.171690 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b699e74f-b468-4185-a494-f3233eda2c15 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:25.172314 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b699e74f-b468-4185-a494-f3233eda2c15 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:25.183334 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b699e74f-b468-4185-a494-f3233eda2c15 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:25.183334 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b699e74f-b468-4185-a494-f3233eda2c15 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:25.183334 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b699e74f-b468-4185-a494-f3233eda2c15 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:25.183334 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b699e74f-b468-4185-a494-f3233eda2c15 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:25.335743 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b699e74f-b468-4185-a494-f3233eda2c15 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:25.343988 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b699e74f-b468-4185-a494-f3233eda2c15 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.176091 Jun 16 19:44:25.344554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 59/118] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:25 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:25.391460 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fd34be30-3be2-477a-937b-0a578886e353 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:25.392071 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fd34be30-3be2-477a-937b-0a578886e353 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:25.398054 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd34be30-3be2-477a-937b-0a578886e353 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:25.398492 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd34be30-3be2-477a-937b-0a578886e353 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:25.399631 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd34be30-3be2-477a-937b-0a578886e353 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:25.399727 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd34be30-3be2-477a-937b-0a578886e353 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:25.578621 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fd34be30-3be2-477a-937b-0a578886e353 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:25.586715 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fd34be30-3be2-477a-937b-0a578886e353 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.198969 Jun 16 19:44:25.587308 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 60/119] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:25 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:25.798774 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0d3224f9-c052-40a4-bef7-4e23c5f0b6bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:25.803124 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0d3224f9-c052-40a4-bef7-4e23c5f0b6bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:25.804189 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2864bdba-1d54-4577-a39e-ec4c51b6fc96 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:25.805979 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2864bdba-1d54-4577-a39e-ec4c51b6fc96 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:25.806562 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0d3224f9-c052-40a4-bef7-4e23c5f0b6bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:25.807045 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0d3224f9-c052-40a4-bef7-4e23c5f0b6bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:25.808327 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0d3224f9-c052-40a4-bef7-4e23c5f0b6bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:25.808758 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0d3224f9-c052-40a4-bef7-4e23c5f0b6bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:25.815108 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2864bdba-1d54-4577-a39e-ec4c51b6fc96 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:25.815108 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2864bdba-1d54-4577-a39e-ec4c51b6fc96 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:25.815471 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2864bdba-1d54-4577-a39e-ec4c51b6fc96 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:25.815987 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2864bdba-1d54-4577-a39e-ec4c51b6fc96 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:26.009320 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2864bdba-1d54-4577-a39e-ec4c51b6fc96 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:26.017586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2864bdba-1d54-4577-a39e-ec4c51b6fc96 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.218684 Jun 16 19:44:26.024756 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 61/120] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:25 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:26.219714 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0d3224f9-c052-40a4-bef7-4e23c5f0b6bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:26.227665 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0d3224f9-c052-40a4-bef7-4e23c5f0b6bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:26.229208 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0d3224f9-c052-40a4-bef7-4e23c5f0b6bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:26.230814 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0d3224f9-c052-40a4-bef7-4e23c5f0b6bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.437978 Jun 16 19:44:26.231485 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 60/121] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:25 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:26.361109 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a8fcfd61-ab06-4df3-b368-0b62fd56acda tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:26.361749 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a8fcfd61-ab06-4df3-b368-0b62fd56acda tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:26.367721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a8fcfd61-ab06-4df3-b368-0b62fd56acda tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:26.368169 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a8fcfd61-ab06-4df3-b368-0b62fd56acda tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:26.368934 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a8fcfd61-ab06-4df3-b368-0b62fd56acda tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:26.369369 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a8fcfd61-ab06-4df3-b368-0b62fd56acda tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:26.496073 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a8fcfd61-ab06-4df3-b368-0b62fd56acda tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:26.503490 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a8fcfd61-ab06-4df3-b368-0b62fd56acda tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.146216 Jun 16 19:44:26.504052 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 62/122] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:26 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:26.604527 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a46e4626-8686-4345-9640-cf20d8e5670d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:26.605217 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a46e4626-8686-4345-9640-cf20d8e5670d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:26.615274 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a46e4626-8686-4345-9640-cf20d8e5670d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:26.615274 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a46e4626-8686-4345-9640-cf20d8e5670d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:26.615274 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a46e4626-8686-4345-9640-cf20d8e5670d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:26.615634 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a46e4626-8686-4345-9640-cf20d8e5670d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:26.770527 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a46e4626-8686-4345-9640-cf20d8e5670d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:26.778464 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a46e4626-8686-4345-9640-cf20d8e5670d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.177921 Jun 16 19:44:26.779040 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 61/123] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:26 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:27.033899 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e3bbe49f-7ca5-4e46-a25d-d8c0631c1c92 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:27.034504 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e3bbe49f-7ca5-4e46-a25d-d8c0631c1c92 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:27.040340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e3bbe49f-7ca5-4e46-a25d-d8c0631c1c92 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:27.040782 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e3bbe49f-7ca5-4e46-a25d-d8c0631c1c92 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:27.041565 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e3bbe49f-7ca5-4e46-a25d-d8c0631c1c92 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:27.041996 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e3bbe49f-7ca5-4e46-a25d-d8c0631c1c92 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:27.174136 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e3bbe49f-7ca5-4e46-a25d-d8c0631c1c92 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:27.185108 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e3bbe49f-7ca5-4e46-a25d-d8c0631c1c92 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.154896 Jun 16 19:44:27.186546 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 63/124] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:27 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:27.249221 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b81b2e41-d88b-47a0-bcc5-64c4c2363e56 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:27.249831 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b81b2e41-d88b-47a0-bcc5-64c4c2363e56 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:27.256001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b81b2e41-d88b-47a0-bcc5-64c4c2363e56 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:27.256456 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b81b2e41-d88b-47a0-bcc5-64c4c2363e56 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:27.257227 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b81b2e41-d88b-47a0-bcc5-64c4c2363e56 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:27.257663 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b81b2e41-d88b-47a0-bcc5-64c4c2363e56 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:27.388639 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b81b2e41-d88b-47a0-bcc5-64c4c2363e56 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:27.396753 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b81b2e41-d88b-47a0-bcc5-64c4c2363e56 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:27.398437 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b81b2e41-d88b-47a0-bcc5-64c4c2363e56 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:27.399594 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b81b2e41-d88b-47a0-bcc5-64c4c2363e56 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.155038 Jun 16 19:44:27.400156 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 62/125] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:27 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:27.520026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6b384f51-8496-4a15-9c49-4d0cf0af710f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:27.520626 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6b384f51-8496-4a15-9c49-4d0cf0af710f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:27.527952 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6b384f51-8496-4a15-9c49-4d0cf0af710f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:27.528376 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6b384f51-8496-4a15-9c49-4d0cf0af710f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:27.529136 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6b384f51-8496-4a15-9c49-4d0cf0af710f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:27.529561 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6b384f51-8496-4a15-9c49-4d0cf0af710f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:27.658509 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6b384f51-8496-4a15-9c49-4d0cf0af710f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:27.666371 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6b384f51-8496-4a15-9c49-4d0cf0af710f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.150285 Jun 16 19:44:27.667080 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 64/126] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:27 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:27.795402 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-91a942e4-e9d7-46a4-a988-68dbce1d10e5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:27.796457 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-91a942e4-e9d7-46a4-a988-68dbce1d10e5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:27.802056 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-91a942e4-e9d7-46a4-a988-68dbce1d10e5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:27.802505 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-91a942e4-e9d7-46a4-a988-68dbce1d10e5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:27.803312 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-91a942e4-e9d7-46a4-a988-68dbce1d10e5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:27.803750 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-91a942e4-e9d7-46a4-a988-68dbce1d10e5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:27.939153 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-91a942e4-e9d7-46a4-a988-68dbce1d10e5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:27.947600 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-91a942e4-e9d7-46a4-a988-68dbce1d10e5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.155937 Jun 16 19:44:27.957680 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 63/127] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:27 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:28.201881 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0f5e6bbe-ee17-45e1-87bc-1ceec6059d68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:28.202485 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0f5e6bbe-ee17-45e1-87bc-1ceec6059d68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:28.209115 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0f5e6bbe-ee17-45e1-87bc-1ceec6059d68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:28.209550 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0f5e6bbe-ee17-45e1-87bc-1ceec6059d68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:28.210298 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0f5e6bbe-ee17-45e1-87bc-1ceec6059d68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:28.210728 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0f5e6bbe-ee17-45e1-87bc-1ceec6059d68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:28.353676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0f5e6bbe-ee17-45e1-87bc-1ceec6059d68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:28.363689 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0f5e6bbe-ee17-45e1-87bc-1ceec6059d68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.165688 Jun 16 19:44:28.365210 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 65/128] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:28 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:28.419377 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-18c8c3f6-af08-4c20-a322-5ed4cd35e08a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:28.420549 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-18c8c3f6-af08-4c20-a322-5ed4cd35e08a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:28.436129 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-18c8c3f6-af08-4c20-a322-5ed4cd35e08a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:28.436129 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-18c8c3f6-af08-4c20-a322-5ed4cd35e08a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:28.436129 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-18c8c3f6-af08-4c20-a322-5ed4cd35e08a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:28.436129 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-18c8c3f6-af08-4c20-a322-5ed4cd35e08a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:28.466505 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:28.587685 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-18c8c3f6-af08-4c20-a322-5ed4cd35e08a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:28.596128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-18c8c3f6-af08-4c20-a322-5ed4cd35e08a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:28.597666 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-18c8c3f6-af08-4c20-a322-5ed4cd35e08a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:28.598753 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-18c8c3f6-af08-4c20-a322-5ed4cd35e08a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.184507 Jun 16 19:44:28.599352 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 64/129] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:28 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:28.684533 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-dfaca3be-41ca-4b0e-bc81-336b53a6969b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:28.685345 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-dfaca3be-41ca-4b0e-bc81-336b53a6969b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:28.691731 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dfaca3be-41ca-4b0e-bc81-336b53a6969b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:28.692212 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dfaca3be-41ca-4b0e-bc81-336b53a6969b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:28.693005 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dfaca3be-41ca-4b0e-bc81-336b53a6969b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:28.693613 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dfaca3be-41ca-4b0e-bc81-336b53a6969b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:28.839303 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-dfaca3be-41ca-4b0e-bc81-336b53a6969b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:28.846882 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-dfaca3be-41ca-4b0e-bc81-336b53a6969b tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.167389 Jun 16 19:44:28.847556 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 66/130] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:28 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:28.966079 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-aff66ef3-c3ad-404b-bbb2-ce26359413fb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:28.966801 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-aff66ef3-c3ad-404b-bbb2-ce26359413fb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:28.973017 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-aff66ef3-c3ad-404b-bbb2-ce26359413fb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:28.973445 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-aff66ef3-c3ad-404b-bbb2-ce26359413fb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:28.974199 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-aff66ef3-c3ad-404b-bbb2-ce26359413fb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:28.974628 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-aff66ef3-c3ad-404b-bbb2-ce26359413fb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:29.114722 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-aff66ef3-c3ad-404b-bbb2-ce26359413fb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:29.122858 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-aff66ef3-c3ad-404b-bbb2-ce26359413fb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.161539 Jun 16 19:44:29.134468 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 65/131] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:28 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:29.385412 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-804d01a4-705d-41a8-a9ac-aa458db2bdc5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:29.387534 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-804d01a4-705d-41a8-a9ac-aa458db2bdc5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:29.417922 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-804d01a4-705d-41a8-a9ac-aa458db2bdc5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:29.418760 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-804d01a4-705d-41a8-a9ac-aa458db2bdc5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:29.419907 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-804d01a4-705d-41a8-a9ac-aa458db2bdc5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:29.422623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-804d01a4-705d-41a8-a9ac-aa458db2bdc5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:29.621871 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6e3d3f26-907c-4370-9bc9-3617b162ec91 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:29.623052 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6e3d3f26-907c-4370-9bc9-3617b162ec91 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:29.631355 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6e3d3f26-907c-4370-9bc9-3617b162ec91 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:29.632652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6e3d3f26-907c-4370-9bc9-3617b162ec91 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:29.633606 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6e3d3f26-907c-4370-9bc9-3617b162ec91 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:29.634201 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6e3d3f26-907c-4370-9bc9-3617b162ec91 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:29.925342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6e3d3f26-907c-4370-9bc9-3617b162ec91 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:29.963990 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6e3d3f26-907c-4370-9bc9-3617b162ec91 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:29.999132 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6e3d3f26-907c-4370-9bc9-3617b162ec91 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:30.004713 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6e3d3f26-907c-4370-9bc9-3617b162ec91 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.389812 Jun 16 19:44:30.006519 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 66/132] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:29 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:30.051504 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-65e8a103-e617-49fa-9c69-e24a288fd68f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:30.052240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-65e8a103-e617-49fa-9c69-e24a288fd68f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:30.062285 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-65e8a103-e617-49fa-9c69-e24a288fd68f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:30.066339 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-65e8a103-e617-49fa-9c69-e24a288fd68f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:30.069406 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-65e8a103-e617-49fa-9c69-e24a288fd68f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:30.070041 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-65e8a103-e617-49fa-9c69-e24a288fd68f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:30.139020 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-804d01a4-705d-41a8-a9ac-aa458db2bdc5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:30.149087 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-804d01a4-705d-41a8-a9ac-aa458db2bdc5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.769163 Jun 16 19:44:30.153050 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 67/133] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:29 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:30.170873 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d18d9e45-6a48-473e-9638-6b1ef76761a1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:30.171884 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d18d9e45-6a48-473e-9638-6b1ef76761a1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:30.188411 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d18d9e45-6a48-473e-9638-6b1ef76761a1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:30.191935 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d18d9e45-6a48-473e-9638-6b1ef76761a1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:30.192945 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d18d9e45-6a48-473e-9638-6b1ef76761a1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:30.193578 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d18d9e45-6a48-473e-9638-6b1ef76761a1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:30.282170 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-65e8a103-e617-49fa-9c69-e24a288fd68f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:30.291180 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-65e8a103-e617-49fa-9c69-e24a288fd68f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.281643 Jun 16 19:44:30.293297 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 67/134] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:30 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:30.341459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d18d9e45-6a48-473e-9638-6b1ef76761a1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:30.349270 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d18d9e45-6a48-473e-9638-6b1ef76761a1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.194857 Jun 16 19:44:30.349980 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 68/135] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:30 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:31.023263 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bfe48944-1962-428f-a58b-498fb340fde5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:31.023942 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-bfe48944-1962-428f-a58b-498fb340fde5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:31.030658 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bfe48944-1962-428f-a58b-498fb340fde5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:31.031212 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bfe48944-1962-428f-a58b-498fb340fde5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:31.037611 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bfe48944-1962-428f-a58b-498fb340fde5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:31.037611 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bfe48944-1962-428f-a58b-498fb340fde5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:31.173181 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9fd2e1e2-ff9e-466f-b6f2-7ee94c29b083 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:31.174806 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9fd2e1e2-ff9e-466f-b6f2-7ee94c29b083 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:31.183377 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9fd2e1e2-ff9e-466f-b6f2-7ee94c29b083 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:31.184030 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9fd2e1e2-ff9e-466f-b6f2-7ee94c29b083 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:31.185160 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9fd2e1e2-ff9e-466f-b6f2-7ee94c29b083 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:31.186095 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9fd2e1e2-ff9e-466f-b6f2-7ee94c29b083 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:31.210398 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-bfe48944-1962-428f-a58b-498fb340fde5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:31.213276 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:31.220174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-bfe48944-1962-428f-a58b-498fb340fde5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:31.221967 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-bfe48944-1962-428f-a58b-498fb340fde5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:31.223149 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-bfe48944-1962-428f-a58b-498fb340fde5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.203858 Jun 16 19:44:31.223799 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 68/136] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:31 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:31.309997 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b9a6d046-911c-42ad-8388-9154292e7e2f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:31.310612 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b9a6d046-911c-42ad-8388-9154292e7e2f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:31.318034 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b9a6d046-911c-42ad-8388-9154292e7e2f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:31.318802 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b9a6d046-911c-42ad-8388-9154292e7e2f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:31.320033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b9a6d046-911c-42ad-8388-9154292e7e2f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:31.320622 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b9a6d046-911c-42ad-8388-9154292e7e2f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:31.336070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9fd2e1e2-ff9e-466f-b6f2-7ee94c29b083 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:31.344990 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9fd2e1e2-ff9e-466f-b6f2-7ee94c29b083 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.177204 Jun 16 19:44:31.345889 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 69/137] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:31 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:31.369479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1ca153bc-9a86-4082-baf6-a3177c5ac628 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:31.370566 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1ca153bc-9a86-4082-baf6-a3177c5ac628 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:31.376596 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1ca153bc-9a86-4082-baf6-a3177c5ac628 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:31.377356 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1ca153bc-9a86-4082-baf6-a3177c5ac628 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:31.378274 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1ca153bc-9a86-4082-baf6-a3177c5ac628 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:31.378896 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1ca153bc-9a86-4082-baf6-a3177c5ac628 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:31.477091 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b9a6d046-911c-42ad-8388-9154292e7e2f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:31.485325 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b9a6d046-911c-42ad-8388-9154292e7e2f tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.179826 Jun 16 19:44:31.486151 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 69/138] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:31 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:31.514750 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1ca153bc-9a86-4082-baf6-a3177c5ac628 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:31.522060 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1ca153bc-9a86-4082-baf6-a3177c5ac628 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.158766 Jun 16 19:44:31.522623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 70/139] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:31 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:32.242231 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c80791c7-23a0-47fb-88e9-5b91005a0ce2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:32.242835 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c80791c7-23a0-47fb-88e9-5b91005a0ce2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:32.249301 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c80791c7-23a0-47fb-88e9-5b91005a0ce2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:32.249745 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c80791c7-23a0-47fb-88e9-5b91005a0ce2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:32.250495 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c80791c7-23a0-47fb-88e9-5b91005a0ce2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:32.250937 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c80791c7-23a0-47fb-88e9-5b91005a0ce2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:32.361769 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-723a81a3-735d-4d18-b854-0ed56d2fc675 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:32.362388 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-723a81a3-735d-4d18-b854-0ed56d2fc675 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:32.368454 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-723a81a3-735d-4d18-b854-0ed56d2fc675 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:32.368898 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-723a81a3-735d-4d18-b854-0ed56d2fc675 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:32.370304 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-723a81a3-735d-4d18-b854-0ed56d2fc675 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:32.371072 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-723a81a3-735d-4d18-b854-0ed56d2fc675 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:32.375884 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c80791c7-23a0-47fb-88e9-5b91005a0ce2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:32.384318 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c80791c7-23a0-47fb-88e9-5b91005a0ce2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:32.386618 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c80791c7-23a0-47fb-88e9-5b91005a0ce2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:32.387991 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c80791c7-23a0-47fb-88e9-5b91005a0ce2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.149579 Jun 16 19:44:32.389147 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 70/140] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:32 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:32.499693 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-723a81a3-735d-4d18-b854-0ed56d2fc675 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:32.501562 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f37a109c-5c56-4dd8-b11d-ef835a07b374 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:32.502116 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f37a109c-5c56-4dd8-b11d-ef835a07b374 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:32.505003 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:32.507155 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-723a81a3-735d-4d18-b854-0ed56d2fc675 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.149477 Jun 16 19:44:32.507842 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 71/141] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:32 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:32.509606 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f37a109c-5c56-4dd8-b11d-ef835a07b374 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:32.510056 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f37a109c-5c56-4dd8-b11d-ef835a07b374 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:32.511403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f37a109c-5c56-4dd8-b11d-ef835a07b374 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:32.511842 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f37a109c-5c56-4dd8-b11d-ef835a07b374 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:32.539039 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4486fbc8-c921-4651-b426-15ba4921b04a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:32.539655 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4486fbc8-c921-4651-b426-15ba4921b04a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:32.545803 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4486fbc8-c921-4651-b426-15ba4921b04a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:32.546253 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4486fbc8-c921-4651-b426-15ba4921b04a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:32.547053 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4486fbc8-c921-4651-b426-15ba4921b04a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:32.556679 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4486fbc8-c921-4651-b426-15ba4921b04a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:32.651125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f37a109c-5c56-4dd8-b11d-ef835a07b374 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:32.660319 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f37a109c-5c56-4dd8-b11d-ef835a07b374 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.162076 Jun 16 19:44:32.660896 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 71/142] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:32 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:32.683219 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4486fbc8-c921-4651-b426-15ba4921b04a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:32.690552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4486fbc8-c921-4651-b426-15ba4921b04a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.155907 Jun 16 19:44:32.691143 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 72/143] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:32 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:33.406916 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a3482ed6-f125-4574-b845-53ac51238d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:33.407557 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a3482ed6-f125-4574-b845-53ac51238d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:33.413602 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a3482ed6-f125-4574-b845-53ac51238d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:33.414047 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a3482ed6-f125-4574-b845-53ac51238d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:33.414892 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a3482ed6-f125-4574-b845-53ac51238d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:33.415350 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a3482ed6-f125-4574-b845-53ac51238d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:33.524478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1be40c1a-a372-4cfe-94a2-4f48ec16021e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:33.525085 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1be40c1a-a372-4cfe-94a2-4f48ec16021e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:33.532294 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1be40c1a-a372-4cfe-94a2-4f48ec16021e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:33.533943 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1be40c1a-a372-4cfe-94a2-4f48ec16021e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:33.533943 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1be40c1a-a372-4cfe-94a2-4f48ec16021e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:33.534369 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1be40c1a-a372-4cfe-94a2-4f48ec16021e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:33.546640 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a3482ed6-f125-4574-b845-53ac51238d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:33.562554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a3482ed6-f125-4574-b845-53ac51238d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:33.566604 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a3482ed6-f125-4574-b845-53ac51238d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:33.568497 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a3482ed6-f125-4574-b845-53ac51238d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.165186 Jun 16 19:44:33.580184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 72/144] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:33 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:33.679823 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6a7c666c-693f-411f-afa7-6742e2db1f43 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:33.680624 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6a7c666c-693f-411f-afa7-6742e2db1f43 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:33.687552 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6a7c666c-693f-411f-afa7-6742e2db1f43 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:33.688083 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6a7c666c-693f-411f-afa7-6742e2db1f43 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:33.689135 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6a7c666c-693f-411f-afa7-6742e2db1f43 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:33.689643 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6a7c666c-693f-411f-afa7-6742e2db1f43 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:33.693972 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1be40c1a-a372-4cfe-94a2-4f48ec16021e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:33.703629 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1be40c1a-a372-4cfe-94a2-4f48ec16021e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.182808 Jun 16 19:44:33.708971 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 73/145] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:33 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:33.709936 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-184cbc65-5b59-43fa-81e0-35a49a5b2435 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:33.710702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-184cbc65-5b59-43fa-81e0-35a49a5b2435 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:33.718173 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-184cbc65-5b59-43fa-81e0-35a49a5b2435 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:33.718785 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-184cbc65-5b59-43fa-81e0-35a49a5b2435 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:33.719730 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-184cbc65-5b59-43fa-81e0-35a49a5b2435 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:33.720316 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-184cbc65-5b59-43fa-81e0-35a49a5b2435 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:33.877512 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6a7c666c-693f-411f-afa7-6742e2db1f43 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:33.888359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6a7c666c-693f-411f-afa7-6742e2db1f43 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.214450 Jun 16 19:44:33.898000 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-184cbc65-5b59-43fa-81e0-35a49a5b2435 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:33.898792 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 73/146] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:33 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:33.909376 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-184cbc65-5b59-43fa-81e0-35a49a5b2435 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.200542 Jun 16 19:44:33.909376 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 74/147] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:33 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:34.588287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-ca4d79b3-a9a7-47e9-b051-a95fa23994d5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:34.588909 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-ca4d79b3-a9a7-47e9-b051-a95fa23994d5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:34.594880 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ca4d79b3-a9a7-47e9-b051-a95fa23994d5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:34.595362 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ca4d79b3-a9a7-47e9-b051-a95fa23994d5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:34.596124 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ca4d79b3-a9a7-47e9-b051-a95fa23994d5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:34.596559 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ca4d79b3-a9a7-47e9-b051-a95fa23994d5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:34.726518 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0603bdb5-28a1-418e-9ace-75c5d6726616 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:34.728201 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0603bdb5-28a1-418e-9ace-75c5d6726616 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:34.735785 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0603bdb5-28a1-418e-9ace-75c5d6726616 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:34.736550 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0603bdb5-28a1-418e-9ace-75c5d6726616 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:34.737811 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0603bdb5-28a1-418e-9ace-75c5d6726616 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:34.738527 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0603bdb5-28a1-418e-9ace-75c5d6726616 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:34.819500 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ca4d79b3-a9a7-47e9-b051-a95fa23994d5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:34.833916 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ca4d79b3-a9a7-47e9-b051-a95fa23994d5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:34.835632 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ca4d79b3-a9a7-47e9-b051-a95fa23994d5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:34.837739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-ca4d79b3-a9a7-47e9-b051-a95fa23994d5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.253296 Jun 16 19:44:34.838334 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 74/148] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:34 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:34.896992 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0603bdb5-28a1-418e-9ace-75c5d6726616 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:34.905108 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6ea92d1a-67aa-403e-910f-92a0fc4054a7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:34.905808 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6ea92d1a-67aa-403e-910f-92a0fc4054a7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:34.911838 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6ea92d1a-67aa-403e-910f-92a0fc4054a7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:34.912280 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6ea92d1a-67aa-403e-910f-92a0fc4054a7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:34.912828 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0603bdb5-28a1-418e-9ace-75c5d6726616 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.191205 Jun 16 19:44:34.913034 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6ea92d1a-67aa-403e-910f-92a0fc4054a7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:34.913418 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 75/149] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:34 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:34.913543 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6ea92d1a-67aa-403e-910f-92a0fc4054a7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:34.922992 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bd845fec-9d20-41ac-8cf0-b821ae68a765 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:34.924694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-bd845fec-9d20-41ac-8cf0-b821ae68a765 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:34.929631 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bd845fec-9d20-41ac-8cf0-b821ae68a765 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:34.930071 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bd845fec-9d20-41ac-8cf0-b821ae68a765 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:34.930821 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bd845fec-9d20-41ac-8cf0-b821ae68a765 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:34.931282 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bd845fec-9d20-41ac-8cf0-b821ae68a765 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:35.055761 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6ea92d1a-67aa-403e-910f-92a0fc4054a7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:35.078831 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-bd845fec-9d20-41ac-8cf0-b821ae68a765 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:35.087650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-bd845fec-9d20-41ac-8cf0-b821ae68a765 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.168002 Jun 16 19:44:35.097097 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6ea92d1a-67aa-403e-910f-92a0fc4054a7 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.193436 Jun 16 19:44:35.097816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 76/150] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:34 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:35.098257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 75/151] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:34 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:35.856114 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-72786867-d847-48cf-85c0-24a4a8c76830 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:35.856731 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-72786867-d847-48cf-85c0-24a4a8c76830 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:35.863954 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-72786867-d847-48cf-85c0-24a4a8c76830 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:35.864408 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-72786867-d847-48cf-85c0-24a4a8c76830 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:35.865186 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-72786867-d847-48cf-85c0-24a4a8c76830 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:35.865831 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-72786867-d847-48cf-85c0-24a4a8c76830 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:35.879883 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-eea3a002-9147-4155-9c16-aeba173993d0 req-c0351553-9cac-4fcd-b548-5edf2c378f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f5ae39-c48a-49e8-81b0-5f1ea289f14f", "name": "network-vif-plugged", "status": "completed", "tag": "8eabf1a8-e341-4228-bdcf-f29f74159486"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:35.891294 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-eea3a002-9147-4155-9c16-aeba173993d0 req-c0351553-9cac-4fcd-b548-5edf2c378f61 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:35.892169 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-eea3a002-9147-4155-9c16-aeba173993d0 req-c0351553-9cac-4fcd-b548-5edf2c378f61 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:35.906854 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-eea3a002-9147-4155-9c16-aeba173993d0 req-c0351553-9cac-4fcd-b548-5edf2c378f61 service nova] Creating event network-vif-plugged:8eabf1a8-e341-4228-bdcf-f29f74159486 for instance 02f5ae39-c48a-49e8-81b0-5f1ea289f14f on hv-cinder-84617 Jun 16 19:44:35.912148 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-eea3a002-9147-4155-9c16-aeba173993d0 req-c0351553-9cac-4fcd-b548-5edf2c378f61 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144490 Jun 16 19:44:35.912808 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 77/152] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:44:35.929988 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-437bec87-c5f8-498c-89e3-ea84f407f86d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:35.930892 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-437bec87-c5f8-498c-89e3-ea84f407f86d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:35.940002 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-437bec87-c5f8-498c-89e3-ea84f407f86d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:35.940684 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-437bec87-c5f8-498c-89e3-ea84f407f86d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:35.941645 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-437bec87-c5f8-498c-89e3-ea84f407f86d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:35.942255 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-437bec87-c5f8-498c-89e3-ea84f407f86d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:36.120671 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-437bec87-c5f8-498c-89e3-ea84f407f86d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:36.121037 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-72786867-d847-48cf-85c0-24a4a8c76830 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:36.130843 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-437bec87-c5f8-498c-89e3-ea84f407f86d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.204504 Jun 16 19:44:36.140042 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 78/153] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:35 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:36.140042 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a95ad779-21bc-476c-8221-eb912a3eccf5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:36.140042 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a95ad779-21bc-476c-8221-eb912a3eccf5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:36.145779 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a95ad779-21bc-476c-8221-eb912a3eccf5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:36.146311 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a95ad779-21bc-476c-8221-eb912a3eccf5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:36.146587 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-72786867-d847-48cf-85c0-24a4a8c76830 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:36.147263 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a95ad779-21bc-476c-8221-eb912a3eccf5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:36.147774 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a95ad779-21bc-476c-8221-eb912a3eccf5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:36.148640 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-72786867-d847-48cf-85c0-24a4a8c76830 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:36.149962 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-72786867-d847-48cf-85c0-24a4a8c76830 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.297747 Jun 16 19:44:36.169144 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 76/154] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:35 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:36.178951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-eef2234e-deba-4931-a9cf-588d6894b5e9 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:36.179814 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-eef2234e-deba-4931-a9cf-588d6894b5e9 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:36.196767 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eef2234e-deba-4931-a9cf-588d6894b5e9 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:36.197455 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eef2234e-deba-4931-a9cf-588d6894b5e9 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:36.200551 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eef2234e-deba-4931-a9cf-588d6894b5e9 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:36.201345 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eef2234e-deba-4931-a9cf-588d6894b5e9 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:36.402275 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a95ad779-21bc-476c-8221-eb912a3eccf5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:36.426950 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a95ad779-21bc-476c-8221-eb912a3eccf5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.292046 Jun 16 19:44:36.428458 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 79/155] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:36 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:36.471629 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-eef2234e-deba-4931-a9cf-588d6894b5e9 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:36.500363 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-eef2234e-deba-4931-a9cf-588d6894b5e9 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.329324 Jun 16 19:44:36.513951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 77/156] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:36 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:37.149513 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-93c1648f-65e0-48f6-854d-babf04acb069 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:37.151924 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-93c1648f-65e0-48f6-854d-babf04acb069 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:37.162857 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93c1648f-65e0-48f6-854d-babf04acb069 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:37.163581 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93c1648f-65e0-48f6-854d-babf04acb069 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:37.164701 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93c1648f-65e0-48f6-854d-babf04acb069 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:37.165304 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93c1648f-65e0-48f6-854d-babf04acb069 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:37.172333 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d24bc987-9a24-4a1a-8f91-654110235a62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:37.173635 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d24bc987-9a24-4a1a-8f91-654110235a62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:37.179876 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d24bc987-9a24-4a1a-8f91-654110235a62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:37.180517 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d24bc987-9a24-4a1a-8f91-654110235a62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:37.181478 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d24bc987-9a24-4a1a-8f91-654110235a62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:37.182058 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d24bc987-9a24-4a1a-8f91-654110235a62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:37.337631 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d24bc987-9a24-4a1a-8f91-654110235a62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:37.339097 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-93c1648f-65e0-48f6-854d-babf04acb069 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:37.346303 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-93c1648f-65e0-48f6-854d-babf04acb069 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.200952 Jun 16 19:44:37.346480 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d24bc987-9a24-4a1a-8f91-654110235a62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:37.346857 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 80/157] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:37 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:37.348224 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d24bc987-9a24-4a1a-8f91-654110235a62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:37.349514 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d24bc987-9a24-4a1a-8f91-654110235a62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.181267 Jun 16 19:44:37.350060 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 78/158] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:37 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:37.445660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8b52fed3-3523-46a3-9b3c-e1199847b1d0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:37.446260 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8b52fed3-3523-46a3-9b3c-e1199847b1d0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:37.452742 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b52fed3-3523-46a3-9b3c-e1199847b1d0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:37.453178 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b52fed3-3523-46a3-9b3c-e1199847b1d0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:37.455004 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b52fed3-3523-46a3-9b3c-e1199847b1d0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:37.455004 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b52fed3-3523-46a3-9b3c-e1199847b1d0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:37.521929 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0c3396ad-1596-4bac-a4fb-b521e732aa5d tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:37.522629 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0c3396ad-1596-4bac-a4fb-b521e732aa5d tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:37.529073 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0c3396ad-1596-4bac-a4fb-b521e732aa5d tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:37.529516 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0c3396ad-1596-4bac-a4fb-b521e732aa5d tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:37.530274 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0c3396ad-1596-4bac-a4fb-b521e732aa5d tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:37.530700 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0c3396ad-1596-4bac-a4fb-b521e732aa5d tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:37.595361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8b52fed3-3523-46a3-9b3c-e1199847b1d0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:37.605640 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8b52fed3-3523-46a3-9b3c-e1199847b1d0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.164004 Jun 16 19:44:37.607148 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 81/159] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:37 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:37.662815 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0c3396ad-1596-4bac-a4fb-b521e732aa5d tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:37.670158 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0c3396ad-1596-4bac-a4fb-b521e732aa5d tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.152421 Jun 16 19:44:37.670716 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 79/160] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:37 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:37.926699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-49ba0062-598d-43e7-b18f-bc94e5444a70 req-e3868577-058e-4901-8e2c-345003396830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7105897-838f-4c95-ae60-85519aedc5f4", "name": "network-vif-plugged", "status": "completed", "tag": "9e5ad711-50b7-4712-b146-3a4866c32613"}, {"server_uuid": "5c939c84-1712-4551-a3e3-cf42be4113fe", "name": "network-vif-plugged", "status": "completed", "tag": "24f9795e-d76d-4b2b-8ac3-7a285df7d774"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:37.936770 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-49ba0062-598d-43e7-b18f-bc94e5444a70 req-e3868577-058e-4901-8e2c-345003396830 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:37.937207 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-49ba0062-598d-43e7-b18f-bc94e5444a70 req-e3868577-058e-4901-8e2c-345003396830 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:37.950420 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-49ba0062-598d-43e7-b18f-bc94e5444a70 req-e3868577-058e-4901-8e2c-345003396830 service nova] Creating event network-vif-plugged:9e5ad711-50b7-4712-b146-3a4866c32613 for instance f7105897-838f-4c95-ae60-85519aedc5f4 on hv-cinder-84617 Jun 16 19:44:37.950915 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-49ba0062-598d-43e7-b18f-bc94e5444a70 req-e3868577-058e-4901-8e2c-345003396830 service nova] Creating event network-vif-plugged:24f9795e-d76d-4b2b-8ac3-7a285df7d774 for instance 5c939c84-1712-4551-a3e3-cf42be4113fe on hv-cinder-84617 Jun 16 19:44:37.957578 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-49ba0062-598d-43e7-b18f-bc94e5444a70 req-e3868577-058e-4901-8e2c-345003396830 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034515 Jun 16 19:44:37.958176 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 82/161] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:44:38.363146 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-feb6b316-ce5e-4490-b74c-99a2c0fa4cee tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:38.363770 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-feb6b316-ce5e-4490-b74c-99a2c0fa4cee tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:38.367542 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d8940d2f-85ee-4d58-a848-fa7e4fa46137 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:38.368425 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d8940d2f-85ee-4d58-a848-fa7e4fa46137 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:38.370014 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-feb6b316-ce5e-4490-b74c-99a2c0fa4cee tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:38.370466 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-feb6b316-ce5e-4490-b74c-99a2c0fa4cee tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:38.371269 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-feb6b316-ce5e-4490-b74c-99a2c0fa4cee tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:38.371708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-feb6b316-ce5e-4490-b74c-99a2c0fa4cee tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:38.374609 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d8940d2f-85ee-4d58-a848-fa7e4fa46137 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:38.375076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d8940d2f-85ee-4d58-a848-fa7e4fa46137 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:38.375868 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d8940d2f-85ee-4d58-a848-fa7e4fa46137 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:38.376294 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d8940d2f-85ee-4d58-a848-fa7e4fa46137 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:38.533501 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d8940d2f-85ee-4d58-a848-fa7e4fa46137 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:38.541587 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d8940d2f-85ee-4d58-a848-fa7e4fa46137 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:38.543253 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d8940d2f-85ee-4d58-a848-fa7e4fa46137 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:38.544374 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d8940d2f-85ee-4d58-a848-fa7e4fa46137 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.181119 Jun 16 19:44:38.544685 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-feb6b316-ce5e-4490-b74c-99a2c0fa4cee tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:38.544945 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 83/162] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:38 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:44:38.552525 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-feb6b316-ce5e-4490-b74c-99a2c0fa4cee tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.193532 Jun 16 19:44:38.553187 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 80/163] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:38 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:38.623917 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-26ac9a9e-29e5-4b9c-bdde-81d80cabd627 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:38.624577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-26ac9a9e-29e5-4b9c-bdde-81d80cabd627 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:38.630510 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-26ac9a9e-29e5-4b9c-bdde-81d80cabd627 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:38.630974 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-26ac9a9e-29e5-4b9c-bdde-81d80cabd627 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:38.631725 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-26ac9a9e-29e5-4b9c-bdde-81d80cabd627 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:38.632153 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-26ac9a9e-29e5-4b9c-bdde-81d80cabd627 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:38.686622 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8add041a-75dd-46e0-8f24-350c8bb322cd tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:38.687172 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8add041a-75dd-46e0-8f24-350c8bb322cd tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:38.693403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8add041a-75dd-46e0-8f24-350c8bb322cd tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:38.693837 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8add041a-75dd-46e0-8f24-350c8bb322cd tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:38.694602 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8add041a-75dd-46e0-8f24-350c8bb322cd tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:38.695308 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8add041a-75dd-46e0-8f24-350c8bb322cd tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:38.699512 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:38.778386 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-26ac9a9e-29e5-4b9c-bdde-81d80cabd627 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:38.786327 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-26ac9a9e-29e5-4b9c-bdde-81d80cabd627 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.166636 Jun 16 19:44:38.787013 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 84/164] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:38 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:38.841223 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8add041a-75dd-46e0-8f24-350c8bb322cd tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:38.848830 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8add041a-75dd-46e0-8f24-350c8bb322cd tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.166656 Jun 16 19:44:38.849394 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 81/165] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:38 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:39.562194 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9d4e045d-22cc-4261-8686-876c824224ad tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:39.562704 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9d4e045d-22cc-4261-8686-876c824224ad tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:39.569131 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d4e045d-22cc-4261-8686-876c824224ad tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:39.569573 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d4e045d-22cc-4261-8686-876c824224ad tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:39.570598 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d4e045d-22cc-4261-8686-876c824224ad tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:39.571054 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d4e045d-22cc-4261-8686-876c824224ad tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:39.579788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-16c509a6-1391-4297-b2f8-825b14423e44 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:39.580400 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-16c509a6-1391-4297-b2f8-825b14423e44 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:39.599398 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-16c509a6-1391-4297-b2f8-825b14423e44 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:39.600110 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-16c509a6-1391-4297-b2f8-825b14423e44 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:39.601047 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-16c509a6-1391-4297-b2f8-825b14423e44 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:39.601492 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-16c509a6-1391-4297-b2f8-825b14423e44 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:39.707836 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9d4e045d-22cc-4261-8686-876c824224ad tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:39.718154 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9d4e045d-22cc-4261-8686-876c824224ad tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:39.720131 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9d4e045d-22cc-4261-8686-876c824224ad tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:39.723378 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9d4e045d-22cc-4261-8686-876c824224ad tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.163000 Jun 16 19:44:39.723378 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 85/166] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:39 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:39.774323 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-16c509a6-1391-4297-b2f8-825b14423e44 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:39.782111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-16c509a6-1391-4297-b2f8-825b14423e44 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.206388 Jun 16 19:44:39.782676 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 82/167] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:39 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:39.803129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-65f6899e-8a58-4ed9-a050-325ad399e636 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:39.803738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-65f6899e-8a58-4ed9-a050-325ad399e636 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:39.810479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-65f6899e-8a58-4ed9-a050-325ad399e636 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:39.810942 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-65f6899e-8a58-4ed9-a050-325ad399e636 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:39.811791 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-65f6899e-8a58-4ed9-a050-325ad399e636 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:39.820904 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-65f6899e-8a58-4ed9-a050-325ad399e636 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:39.865410 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-24f9cbc4-4469-407a-8068-f16aeb0f25e2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:39.866294 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-24f9cbc4-4469-407a-8068-f16aeb0f25e2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:39.874505 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-24f9cbc4-4469-407a-8068-f16aeb0f25e2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:39.875299 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-24f9cbc4-4469-407a-8068-f16aeb0f25e2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:39.876402 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-24f9cbc4-4469-407a-8068-f16aeb0f25e2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:39.877577 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-24f9cbc4-4469-407a-8068-f16aeb0f25e2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:39.954215 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-65f6899e-8a58-4ed9-a050-325ad399e636 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:39.961753 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-65f6899e-8a58-4ed9-a050-325ad399e636 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.162436 Jun 16 19:44:39.963483 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 86/168] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:39 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:40.011407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-24f9cbc4-4469-407a-8068-f16aeb0f25e2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:40.020681 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-24f9cbc4-4469-407a-8068-f16aeb0f25e2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.158968 Jun 16 19:44:40.026762 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 83/169] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:39 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:40.739581 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d7d90364-f70f-43d5-899b-3cc4c308a57b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:40.740195 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d7d90364-f70f-43d5-899b-3cc4c308a57b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:40.746688 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d7d90364-f70f-43d5-899b-3cc4c308a57b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:40.747177 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d7d90364-f70f-43d5-899b-3cc4c308a57b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:40.747940 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d7d90364-f70f-43d5-899b-3cc4c308a57b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:40.748374 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d7d90364-f70f-43d5-899b-3cc4c308a57b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:40.766644 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:40.797987 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-13c9a3e0-5277-49e9-b4d2-94c34cfaf92b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:40.798878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-13c9a3e0-5277-49e9-b4d2-94c34cfaf92b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:40.805077 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-13c9a3e0-5277-49e9-b4d2-94c34cfaf92b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:40.805519 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-13c9a3e0-5277-49e9-b4d2-94c34cfaf92b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:40.806268 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-13c9a3e0-5277-49e9-b4d2-94c34cfaf92b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:40.807251 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-13c9a3e0-5277-49e9-b4d2-94c34cfaf92b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:40.887338 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d7d90364-f70f-43d5-899b-3cc4c308a57b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:40.895271 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d7d90364-f70f-43d5-899b-3cc4c308a57b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:40.896766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d7d90364-f70f-43d5-899b-3cc4c308a57b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:40.897866 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d7d90364-f70f-43d5-899b-3cc4c308a57b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.162184 Jun 16 19:44:40.898426 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 87/170] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:40 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:40.947232 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-13c9a3e0-5277-49e9-b4d2-94c34cfaf92b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:40.957118 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-13c9a3e0-5277-49e9-b4d2-94c34cfaf92b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.163188 Jun 16 19:44:40.957682 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 84/171] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:40 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:40.979211 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6ee93ea1-89ff-4800-85b3-7f9670a7dbbb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:40.979949 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6ee93ea1-89ff-4800-85b3-7f9670a7dbbb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:40.985947 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6ee93ea1-89ff-4800-85b3-7f9670a7dbbb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:40.989461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6ee93ea1-89ff-4800-85b3-7f9670a7dbbb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:40.989461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6ee93ea1-89ff-4800-85b3-7f9670a7dbbb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:40.989461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6ee93ea1-89ff-4800-85b3-7f9670a7dbbb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:41.044833 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7eef5750-6323-4786-b51c-bddc1e613254 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:41.045445 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-7eef5750-6323-4786-b51c-bddc1e613254 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:41.053303 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7eef5750-6323-4786-b51c-bddc1e613254 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:41.054045 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7eef5750-6323-4786-b51c-bddc1e613254 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:41.054826 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7eef5750-6323-4786-b51c-bddc1e613254 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:41.055349 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7eef5750-6323-4786-b51c-bddc1e613254 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:41.115959 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6ee93ea1-89ff-4800-85b3-7f9670a7dbbb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:41.126955 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6ee93ea1-89ff-4800-85b3-7f9670a7dbbb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.152051 Jun 16 19:44:41.136507 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 88/172] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:40 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:41.199556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-7eef5750-6323-4786-b51c-bddc1e613254 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:41.207102 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-7eef5750-6323-4786-b51c-bddc1e613254 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.166566 Jun 16 19:44:41.207660 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 85/173] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:41 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:41.915437 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e24447e4-88f7-467d-80a8-125b9f4a62e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:41.916039 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e24447e4-88f7-467d-80a8-125b9f4a62e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:41.919465 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:41.922800 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e24447e4-88f7-467d-80a8-125b9f4a62e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:41.923268 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e24447e4-88f7-467d-80a8-125b9f4a62e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:41.924013 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e24447e4-88f7-467d-80a8-125b9f4a62e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:41.924445 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e24447e4-88f7-467d-80a8-125b9f4a62e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:41.972801 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0a8d255f-4bd3-4d5e-ae81-5762e2f913f7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:41.973412 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0a8d255f-4bd3-4d5e-ae81-5762e2f913f7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:41.980107 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0a8d255f-4bd3-4d5e-ae81-5762e2f913f7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:41.980583 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0a8d255f-4bd3-4d5e-ae81-5762e2f913f7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:41.981368 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0a8d255f-4bd3-4d5e-ae81-5762e2f913f7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:41.981802 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0a8d255f-4bd3-4d5e-ae81-5762e2f913f7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:42.053166 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e24447e4-88f7-467d-80a8-125b9f4a62e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:42.061141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e24447e4-88f7-467d-80a8-125b9f4a62e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:42.062640 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e24447e4-88f7-467d-80a8-125b9f4a62e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:42.063786 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e24447e4-88f7-467d-80a8-125b9f4a62e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.152174 Jun 16 19:44:42.064350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 89/174] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:41 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:42.107386 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0a8d255f-4bd3-4d5e-ae81-5762e2f913f7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:42.114886 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0a8d255f-4bd3-4d5e-ae81-5762e2f913f7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.145970 Jun 16 19:44:42.115461 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 86/175] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:41 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:42.143750 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e0d48116-b8e2-4646-bf6d-dcfa9e112884 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:42.144334 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e0d48116-b8e2-4646-bf6d-dcfa9e112884 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:42.150245 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e0d48116-b8e2-4646-bf6d-dcfa9e112884 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:42.150691 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e0d48116-b8e2-4646-bf6d-dcfa9e112884 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:42.151597 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e0d48116-b8e2-4646-bf6d-dcfa9e112884 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:42.152035 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e0d48116-b8e2-4646-bf6d-dcfa9e112884 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:42.224152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-396ec29b-d2a5-4888-ab7c-dfd7fee78911 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:42.224760 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-396ec29b-d2a5-4888-ab7c-dfd7fee78911 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:42.230863 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-396ec29b-d2a5-4888-ab7c-dfd7fee78911 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:42.231335 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-396ec29b-d2a5-4888-ab7c-dfd7fee78911 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:42.232087 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-396ec29b-d2a5-4888-ab7c-dfd7fee78911 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:42.232513 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-396ec29b-d2a5-4888-ab7c-dfd7fee78911 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:42.284014 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e0d48116-b8e2-4646-bf6d-dcfa9e112884 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:42.291726 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e0d48116-b8e2-4646-bf6d-dcfa9e112884 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.151734 Jun 16 19:44:42.292294 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 90/176] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:42 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:42.366219 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-396ec29b-d2a5-4888-ab7c-dfd7fee78911 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:42.374222 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-396ec29b-d2a5-4888-ab7c-dfd7fee78911 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.153870 Jun 16 19:44:42.374775 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 87/177] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:42 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:43.081750 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f3593bb6-4305-4dd1-a8b3-87cdf3328450 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:43.082384 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f3593bb6-4305-4dd1-a8b3-87cdf3328450 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:43.088349 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f3593bb6-4305-4dd1-a8b3-87cdf3328450 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:43.088790 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f3593bb6-4305-4dd1-a8b3-87cdf3328450 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:43.089538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f3593bb6-4305-4dd1-a8b3-87cdf3328450 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:43.089968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f3593bb6-4305-4dd1-a8b3-87cdf3328450 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:43.131182 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-05ad52a4-551a-4627-88b5-a33ca1c497d9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:43.131838 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-05ad52a4-551a-4627-88b5-a33ca1c497d9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:43.138265 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05ad52a4-551a-4627-88b5-a33ca1c497d9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:43.138708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05ad52a4-551a-4627-88b5-a33ca1c497d9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:43.139516 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05ad52a4-551a-4627-88b5-a33ca1c497d9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:43.139997 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05ad52a4-551a-4627-88b5-a33ca1c497d9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:43.233806 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f3593bb6-4305-4dd1-a8b3-87cdf3328450 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:43.244437 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f3593bb6-4305-4dd1-a8b3-87cdf3328450 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:43.246824 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f3593bb6-4305-4dd1-a8b3-87cdf3328450 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:43.249036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f3593bb6-4305-4dd1-a8b3-87cdf3328450 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.170686 Jun 16 19:44:43.259672 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 91/178] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:43 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:44:43.308189 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-055c84ed-a52c-44c9-adc7-a6a83da7ee6c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:43.309542 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-055c84ed-a52c-44c9-adc7-a6a83da7ee6c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:43.315942 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-055c84ed-a52c-44c9-adc7-a6a83da7ee6c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:43.316397 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-055c84ed-a52c-44c9-adc7-a6a83da7ee6c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:43.317171 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-055c84ed-a52c-44c9-adc7-a6a83da7ee6c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:43.317593 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-055c84ed-a52c-44c9-adc7-a6a83da7ee6c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:43.451252 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-05ad52a4-551a-4627-88b5-a33ca1c497d9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:43.456267 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-055c84ed-a52c-44c9-adc7-a6a83da7ee6c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:43.460106 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-05ad52a4-551a-4627-88b5-a33ca1c497d9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.332767 Jun 16 19:44:43.461174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 88/179] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:43 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:43.466375 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d1863994-50a1-486b-bf68-a268912dfc9a tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:43.467205 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d1863994-50a1-486b-bf68-a268912dfc9a tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:43.476473 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-055c84ed-a52c-44c9-adc7-a6a83da7ee6c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.172173 Jun 16 19:44:43.477429 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 92/180] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:43 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:43.478599 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d1863994-50a1-486b-bf68-a268912dfc9a tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:43.479562 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d1863994-50a1-486b-bf68-a268912dfc9a tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:43.481425 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d1863994-50a1-486b-bf68-a268912dfc9a tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:43.481871 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d1863994-50a1-486b-bf68-a268912dfc9a tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:43.616913 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d1863994-50a1-486b-bf68-a268912dfc9a tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:43.625797 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d1863994-50a1-486b-bf68-a268912dfc9a tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1315 microversion: 2.1 time: 0.163584 Jun 16 19:44:43.626446 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 89/181] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:43 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:44.267540 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-17e1fd60-158b-4e3d-8d92-d93f782d665e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:44.268230 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-17e1fd60-158b-4e3d-8d92-d93f782d665e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:44.274821 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-17e1fd60-158b-4e3d-8d92-d93f782d665e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:44.275375 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-17e1fd60-158b-4e3d-8d92-d93f782d665e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:44.276245 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-17e1fd60-158b-4e3d-8d92-d93f782d665e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:44.276782 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-17e1fd60-158b-4e3d-8d92-d93f782d665e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:44.402103 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-17e1fd60-158b-4e3d-8d92-d93f782d665e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:44.410295 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-17e1fd60-158b-4e3d-8d92-d93f782d665e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:44.411805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-17e1fd60-158b-4e3d-8d92-d93f782d665e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:44.428227 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-17e1fd60-158b-4e3d-8d92-d93f782d665e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.149482 Jun 16 19:44:44.428227 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 93/182] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:44 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:44.477593 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-17dcfbff-f89d-40be-b8d8-8bcffae020cf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:44.478391 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-17dcfbff-f89d-40be-b8d8-8bcffae020cf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:44.486443 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-17dcfbff-f89d-40be-b8d8-8bcffae020cf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:44.487197 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-17dcfbff-f89d-40be-b8d8-8bcffae020cf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:44.488062 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-17dcfbff-f89d-40be-b8d8-8bcffae020cf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:44.489312 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-17dcfbff-f89d-40be-b8d8-8bcffae020cf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:44.506042 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2873a20b-f056-4d4e-bf2a-8271a696bb0d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:44.507087 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2873a20b-f056-4d4e-bf2a-8271a696bb0d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:44.528125 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2873a20b-f056-4d4e-bf2a-8271a696bb0d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:44.528910 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2873a20b-f056-4d4e-bf2a-8271a696bb0d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:44.529697 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2873a20b-f056-4d4e-bf2a-8271a696bb0d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:44.530139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2873a20b-f056-4d4e-bf2a-8271a696bb0d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:44.654609 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-17dcfbff-f89d-40be-b8d8-8bcffae020cf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:44.662292 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-17dcfbff-f89d-40be-b8d8-8bcffae020cf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.188672 Jun 16 19:44:44.662871 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 90/183] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:44 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:44.675782 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1696a266-c6d0-4d51-9cbe-0e04e2b4946c tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:44.676446 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-1696a266-c6d0-4d51-9cbe-0e04e2b4946c tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:44.683156 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1696a266-c6d0-4d51-9cbe-0e04e2b4946c tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:44.683603 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1696a266-c6d0-4d51-9cbe-0e04e2b4946c tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:44.684360 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1696a266-c6d0-4d51-9cbe-0e04e2b4946c tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:44.684783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1696a266-c6d0-4d51-9cbe-0e04e2b4946c tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:44.701751 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2873a20b-f056-4d4e-bf2a-8271a696bb0d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:44.709433 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2873a20b-f056-4d4e-bf2a-8271a696bb0d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.219044 Jun 16 19:44:44.710077 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 94/184] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:44 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:44.826755 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1696a266-c6d0-4d51-9cbe-0e04e2b4946c tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:44.834281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-1696a266-c6d0-4d51-9cbe-0e04e2b4946c tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1503 microversion: 2.1 time: 0.170272 Jun 16 19:44:44.834847 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 91/185] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:44 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:44.996235 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-b7f7be3e-2f1a-4163-8b6c-701f78a94604 req-31bbc668-4992-43ab-b260-bb1819cd80b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f667dde1-232e-4f14-917f-0a749279d6a8", "name": "network-vif-plugged", "status": "completed", "tag": "ce7582ec-7186-425a-a407-f177022e1f52"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:45.033606 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-b7f7be3e-2f1a-4163-8b6c-701f78a94604 req-31bbc668-4992-43ab-b260-bb1819cd80b1 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:45.033912 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-b7f7be3e-2f1a-4163-8b6c-701f78a94604 req-31bbc668-4992-43ab-b260-bb1819cd80b1 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:45.065962 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-b7f7be3e-2f1a-4163-8b6c-701f78a94604 req-31bbc668-4992-43ab-b260-bb1819cd80b1 service nova] Creating event network-vif-plugged:ce7582ec-7186-425a-a407-f177022e1f52 for instance f667dde1-232e-4f14-917f-0a749279d6a8 on hv-cinder-84617 Jun 16 19:44:45.072206 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-b7f7be3e-2f1a-4163-8b6c-701f78a94604 req-31bbc668-4992-43ab-b260-bb1819cd80b1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079901 Jun 16 19:44:45.073278 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 95/186] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:44:45.434780 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f5d24a4b-6f4f-478d-ba6c-c42e8d4e7910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:45.436250 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f5d24a4b-6f4f-478d-ba6c-c42e8d4e7910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:45.447208 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f5d24a4b-6f4f-478d-ba6c-c42e8d4e7910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:45.448387 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f5d24a4b-6f4f-478d-ba6c-c42e8d4e7910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:45.449788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f5d24a4b-6f4f-478d-ba6c-c42e8d4e7910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:45.450678 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f5d24a4b-6f4f-478d-ba6c-c42e8d4e7910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:45.600231 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f5d24a4b-6f4f-478d-ba6c-c42e8d4e7910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:45.608606 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f5d24a4b-6f4f-478d-ba6c-c42e8d4e7910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:45.610102 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f5d24a4b-6f4f-478d-ba6c-c42e8d4e7910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:45.611218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f5d24a4b-6f4f-478d-ba6c-c42e8d4e7910 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.184350 Jun 16 19:44:45.611767 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 92/187] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:45 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:44:45.681299 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d85dc1ab-17db-4939-adf9-e38a3586cb77 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:45.682801 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d85dc1ab-17db-4939-adf9-e38a3586cb77 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:45.689809 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d85dc1ab-17db-4939-adf9-e38a3586cb77 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:45.690249 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d85dc1ab-17db-4939-adf9-e38a3586cb77 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:45.691043 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d85dc1ab-17db-4939-adf9-e38a3586cb77 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:45.691473 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d85dc1ab-17db-4939-adf9-e38a3586cb77 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:45.725728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-23f16c2b-78c9-4943-bfcf-613978851093 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:45.727202 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-23f16c2b-78c9-4943-bfcf-613978851093 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:45.733990 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-23f16c2b-78c9-4943-bfcf-613978851093 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:45.734674 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-23f16c2b-78c9-4943-bfcf-613978851093 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:45.735472 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-23f16c2b-78c9-4943-bfcf-613978851093 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:45.735909 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-23f16c2b-78c9-4943-bfcf-613978851093 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:45.886995 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d85dc1ab-17db-4939-adf9-e38a3586cb77 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:45.894577 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-23f16c2b-78c9-4943-bfcf-613978851093 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:45.900512 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-23f16c2b-78c9-4943-bfcf-613978851093 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.178553 Jun 16 19:44:45.901101 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 93/188] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:45 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:45.905510 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d85dc1ab-17db-4939-adf9-e38a3586cb77 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.229784 Jun 16 19:44:45.906076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 96/189] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:45 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:46.629795 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-73a919d3-956e-4859-9263-de115dff6c6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:46.630411 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-73a919d3-956e-4859-9263-de115dff6c6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:46.636434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-73a919d3-956e-4859-9263-de115dff6c6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:46.636877 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-73a919d3-956e-4859-9263-de115dff6c6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:46.637639 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-73a919d3-956e-4859-9263-de115dff6c6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:46.638081 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-73a919d3-956e-4859-9263-de115dff6c6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:46.766708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-73a919d3-956e-4859-9263-de115dff6c6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:46.774670 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-73a919d3-956e-4859-9263-de115dff6c6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:46.776687 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-73a919d3-956e-4859-9263-de115dff6c6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:46.777777 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-73a919d3-956e-4859-9263-de115dff6c6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.152075 Jun 16 19:44:46.778321 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 94/190] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:46 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:46.918070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-dc057006-e687-45dd-b6e8-b0295d82c8b7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:46.918799 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-dc057006-e687-45dd-b6e8-b0295d82c8b7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:46.921815 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b9425f29-7f5c-432a-adc2-a4244de5ecf8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:46.922552 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b9425f29-7f5c-432a-adc2-a4244de5ecf8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:46.925395 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc057006-e687-45dd-b6e8-b0295d82c8b7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:46.925910 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc057006-e687-45dd-b6e8-b0295d82c8b7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:46.926736 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc057006-e687-45dd-b6e8-b0295d82c8b7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:46.927272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc057006-e687-45dd-b6e8-b0295d82c8b7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:46.930649 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b9425f29-7f5c-432a-adc2-a4244de5ecf8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:46.931148 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b9425f29-7f5c-432a-adc2-a4244de5ecf8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:46.931988 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b9425f29-7f5c-432a-adc2-a4244de5ecf8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:46.933085 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b9425f29-7f5c-432a-adc2-a4244de5ecf8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:47.093501 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-dc057006-e687-45dd-b6e8-b0295d82c8b7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:47.093739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b9425f29-7f5c-432a-adc2-a4244de5ecf8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:47.098094 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-dc057006-e687-45dd-b6e8-b0295d82c8b7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.184531 Jun 16 19:44:47.099073 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 97/191] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:46 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:47.103755 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-32ac0cc9-e8aa-4a23-b0eb-bbe0056902a4 req-581107bb-d939-4760-bb69-576c5ccc330f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe0ce4c-ef63-4027-aa27-b0d53d1554e0", "name": "network-vif-plugged", "status": "completed", "tag": "1ca7b559-06c5-424b-bad3-109e063eafe3"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:47.109411 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b9425f29-7f5c-432a-adc2-a4244de5ecf8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.191037 Jun 16 19:44:47.110519 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 95/192] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:46 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:47.116863 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-32ac0cc9-e8aa-4a23-b0eb-bbe0056902a4 req-581107bb-d939-4760-bb69-576c5ccc330f service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:47.117318 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-32ac0cc9-e8aa-4a23-b0eb-bbe0056902a4 req-581107bb-d939-4760-bb69-576c5ccc330f service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:47.128974 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-32ac0cc9-e8aa-4a23-b0eb-bbe0056902a4 req-581107bb-d939-4760-bb69-576c5ccc330f service nova] Creating event network-vif-plugged:1ca7b559-06c5-424b-bad3-109e063eafe3 for instance dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 on hv-cinder-84617 Jun 16 19:44:47.136027 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-32ac0cc9-e8aa-4a23-b0eb-bbe0056902a4 req-581107bb-d939-4760-bb69-576c5ccc330f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033333 Jun 16 19:44:47.136027 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 98/193] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:44:47.795554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-113a3976-106a-4178-8e44-2bdde8203944 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:47.796160 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-113a3976-106a-4178-8e44-2bdde8203944 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:47.802232 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-113a3976-106a-4178-8e44-2bdde8203944 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:47.802671 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-113a3976-106a-4178-8e44-2bdde8203944 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:47.803445 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-113a3976-106a-4178-8e44-2bdde8203944 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:47.803928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-113a3976-106a-4178-8e44-2bdde8203944 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:47.934577 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-113a3976-106a-4178-8e44-2bdde8203944 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:47.942517 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-113a3976-106a-4178-8e44-2bdde8203944 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:47.946140 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-113a3976-106a-4178-8e44-2bdde8203944 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:47.946140 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-113a3976-106a-4178-8e44-2bdde8203944 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.154227 Jun 16 19:44:47.950965 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 96/194] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:47 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:48.115087 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ceb3e0f2-b843-43b1-ad39-0e20c3f6a83f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:48.115774 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ceb3e0f2-b843-43b1-ad39-0e20c3f6a83f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:48.122318 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ceb3e0f2-b843-43b1-ad39-0e20c3f6a83f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:48.122757 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ceb3e0f2-b843-43b1-ad39-0e20c3f6a83f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:48.123530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ceb3e0f2-b843-43b1-ad39-0e20c3f6a83f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:48.123954 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ceb3e0f2-b843-43b1-ad39-0e20c3f6a83f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:48.126160 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f81c2574-9775-4c13-823d-c0dd836ffef6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:48.126769 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f81c2574-9775-4c13-823d-c0dd836ffef6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:48.132733 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f81c2574-9775-4c13-823d-c0dd836ffef6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:48.133172 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f81c2574-9775-4c13-823d-c0dd836ffef6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:48.133921 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f81c2574-9775-4c13-823d-c0dd836ffef6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:48.134350 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f81c2574-9775-4c13-823d-c0dd836ffef6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:48.253820 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ceb3e0f2-b843-43b1-ad39-0e20c3f6a83f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:48.261722 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ceb3e0f2-b843-43b1-ad39-0e20c3f6a83f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1367 microversion: 2.1 time: 0.150811 Jun 16 19:44:48.262478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 99/195] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:48 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:48.265355 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f81c2574-9775-4c13-823d-c0dd836ffef6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:48.268905 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:48.273123 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f81c2574-9775-4c13-823d-c0dd836ffef6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.150887 Jun 16 19:44:48.273667 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 97/196] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:48 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:44:48.964358 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5cbc9bfe-4a7b-45df-8ad8-0745cc50bce9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:48.964974 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5cbc9bfe-4a7b-45df-8ad8-0745cc50bce9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:48.971276 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5cbc9bfe-4a7b-45df-8ad8-0745cc50bce9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:48.971722 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5cbc9bfe-4a7b-45df-8ad8-0745cc50bce9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:48.972483 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5cbc9bfe-4a7b-45df-8ad8-0745cc50bce9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:48.972922 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5cbc9bfe-4a7b-45df-8ad8-0745cc50bce9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:49.064790 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-20aa20a8-bb0b-44c5-8425-d94a98be90f8 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3632c28-c8d6-4878-8066-af78a1c87c21"}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:49.066480 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-20aa20a8-bb0b-44c5-8425-d94a98be90f8 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:49.073134 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-20aa20a8-bb0b-44c5-8425-d94a98be90f8 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:49.073577 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-20aa20a8-bb0b-44c5-8425-d94a98be90f8 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:49.074568 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-20aa20a8-bb0b-44c5-8425-d94a98be90f8 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:49.075038 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-20aa20a8-bb0b-44c5-8425-d94a98be90f8 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:49.117102 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5cbc9bfe-4a7b-45df-8ad8-0745cc50bce9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:49.127368 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5cbc9bfe-4a7b-45df-8ad8-0745cc50bce9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:49.129681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5cbc9bfe-4a7b-45df-8ad8-0745cc50bce9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:49.131306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5cbc9bfe-4a7b-45df-8ad8-0745cc50bce9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.170782 Jun 16 19:44:49.132553 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 100/197] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:48 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:49.278601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-05a61696-c0d6-446a-a67b-8e66ce1794c6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:49.279169 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-05a61696-c0d6-446a-a67b-8e66ce1794c6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:49.285152 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-05a61696-c0d6-446a-a67b-8e66ce1794c6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:49.285599 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-05a61696-c0d6-446a-a67b-8e66ce1794c6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:49.286589 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-05a61696-c0d6-446a-a67b-8e66ce1794c6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:49.286849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-05a61696-c0d6-446a-a67b-8e66ce1794c6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:49.430193 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-05a61696-c0d6-446a-a67b-8e66ce1794c6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:49.443081 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-05a61696-c0d6-446a-a67b-8e66ce1794c6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1557 microversion: 2.1 time: 0.168357 Jun 16 19:44:49.447070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 101/198] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:49 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:49.451931 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3c9275f4-83be-4bcf-b10c-629d9bd9e1cd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:49.452666 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3c9275f4-83be-4bcf-b10c-629d9bd9e1cd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:49.459562 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3c9275f4-83be-4bcf-b10c-629d9bd9e1cd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:49.460107 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3c9275f4-83be-4bcf-b10c-629d9bd9e1cd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:49.461084 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3c9275f4-83be-4bcf-b10c-629d9bd9e1cd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:49.461615 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3c9275f4-83be-4bcf-b10c-629d9bd9e1cd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:49.595970 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3c9275f4-83be-4bcf-b10c-629d9bd9e1cd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:49.603428 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3c9275f4-83be-4bcf-b10c-629d9bd9e1cd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.158677 Jun 16 19:44:49.603990 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 102/199] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:49 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:49.609071 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b2c9488c-8a5b-4e97-98eb-51cf917baf10 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:49.609549 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b2c9488c-8a5b-4e97-98eb-51cf917baf10 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:49.615238 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b2c9488c-8a5b-4e97-98eb-51cf917baf10 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:49.615677 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b2c9488c-8a5b-4e97-98eb-51cf917baf10 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:49.616470 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b2c9488c-8a5b-4e97-98eb-51cf917baf10 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:49.616874 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b2c9488c-8a5b-4e97-98eb-51cf917baf10 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:49.747378 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b2c9488c-8a5b-4e97-98eb-51cf917baf10 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139493 Jun 16 19:44:49.747378 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 103/200] 10.222.0.36 () {58 vars in 1274 bytes} [Thu Jun 16 19:44:49 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:44:50.149680 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ac7784f7-f4d6-44e7-a3ea-372f1a10ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:50.150367 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ac7784f7-f4d6-44e7-a3ea-372f1a10ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:50.157036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ac7784f7-f4d6-44e7-a3ea-372f1a10ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:50.157483 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ac7784f7-f4d6-44e7-a3ea-372f1a10ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:50.158384 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ac7784f7-f4d6-44e7-a3ea-372f1a10ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:50.158664 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ac7784f7-f4d6-44e7-a3ea-372f1a10ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:50.315344 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ac7784f7-f4d6-44e7-a3ea-372f1a10ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:50.323860 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ac7784f7-f4d6-44e7-a3ea-372f1a10ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:50.325929 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ac7784f7-f4d6-44e7-a3ea-372f1a10ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:50.327057 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ac7784f7-f4d6-44e7-a3ea-372f1a10ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.181379 Jun 16 19:44:50.327614 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 104/201] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:50 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:44:50.529935 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-20aa20a8-bb0b-44c5-8425-d94a98be90f8 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "POST /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.468707 Jun 16 19:44:50.536783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 98/202] 10.222.0.36 () {60 vars in 1322 bytes} [Thu Jun 16 19:44:49 2022] POST /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4/os-volume_attachments => generated 194 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:44:50.620705 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3e340980-850a-4a68-8339-cb3a3be7dacc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:50.621913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3e340980-850a-4a68-8339-cb3a3be7dacc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:50.628026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3e340980-850a-4a68-8339-cb3a3be7dacc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:50.628541 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3e340980-850a-4a68-8339-cb3a3be7dacc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:50.629367 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3e340980-850a-4a68-8339-cb3a3be7dacc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:50.629866 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3e340980-850a-4a68-8339-cb3a3be7dacc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:50.773658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3e340980-850a-4a68-8339-cb3a3be7dacc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:50.777234 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:44:50.781690 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3e340980-850a-4a68-8339-cb3a3be7dacc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1321 microversion: 2.1 time: 0.164942 Jun 16 19:44:50.782263 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 105/203] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:50 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:50.998454 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-0ea8b5c6-bde6-496e-a948-8937220c4e73 req-85283f69-0249-4d44-8634-28c8a20985c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c939c84-1712-4551-a3e3-cf42be4113fe", "tag": "24f9795e-d76d-4b2b-8ac3-7a285df7d774"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:51.007276 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-0ea8b5c6-bde6-496e-a948-8937220c4e73 req-85283f69-0249-4d44-8634-28c8a20985c3 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:51.007712 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-0ea8b5c6-bde6-496e-a948-8937220c4e73 req-85283f69-0249-4d44-8634-28c8a20985c3 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:51.018463 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-0ea8b5c6-bde6-496e-a948-8937220c4e73 req-85283f69-0249-4d44-8634-28c8a20985c3 service nova] Creating event network-changed:24f9795e-d76d-4b2b-8ac3-7a285df7d774 for instance 5c939c84-1712-4551-a3e3-cf42be4113fe on hv-cinder-84617 Jun 16 19:44:51.023469 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-0ea8b5c6-bde6-496e-a948-8937220c4e73 req-85283f69-0249-4d44-8634-28c8a20985c3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030057 Jun 16 19:44:51.024054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 99/204] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:44:51.346300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b701d921-4aac-49b5-8f37-a0bb44eb27ab tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:51.347632 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b701d921-4aac-49b5-8f37-a0bb44eb27ab tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:51.357351 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b701d921-4aac-49b5-8f37-a0bb44eb27ab tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:51.359412 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b701d921-4aac-49b5-8f37-a0bb44eb27ab tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:51.361212 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b701d921-4aac-49b5-8f37-a0bb44eb27ab tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:51.361650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b701d921-4aac-49b5-8f37-a0bb44eb27ab tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:51.580266 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b701d921-4aac-49b5-8f37-a0bb44eb27ab tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:51.588463 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b701d921-4aac-49b5-8f37-a0bb44eb27ab tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:51.590095 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b701d921-4aac-49b5-8f37-a0bb44eb27ab tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:51.591226 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b701d921-4aac-49b5-8f37-a0bb44eb27ab tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1406 microversion: 2.20 time: 0.249993 Jun 16 19:44:51.591781 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 106/205] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:51 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:51.798415 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3bb15894-6d1d-4ced-a698-3c1b6ba4d63f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:51.799136 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-3bb15894-6d1d-4ced-a698-3c1b6ba4d63f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:51.805456 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3bb15894-6d1d-4ced-a698-3c1b6ba4d63f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:51.805807 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3bb15894-6d1d-4ced-a698-3c1b6ba4d63f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:51.806569 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3bb15894-6d1d-4ced-a698-3c1b6ba4d63f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:51.807270 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3bb15894-6d1d-4ced-a698-3c1b6ba4d63f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:52.236892 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3bb15894-6d1d-4ced-a698-3c1b6ba4d63f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:52.239829 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-3bb15894-6d1d-4ced-a698-3c1b6ba4d63f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1515 microversion: 2.1 time: 0.445923 Jun 16 19:44:52.242990 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 100/206] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:51 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1515 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:52.260042 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ef09f038-71fd-4144-a4af-8f0a56b9b6d7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:52.261325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ef09f038-71fd-4144-a4af-8f0a56b9b6d7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:52.273710 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ef09f038-71fd-4144-a4af-8f0a56b9b6d7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:52.274168 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ef09f038-71fd-4144-a4af-8f0a56b9b6d7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:52.274954 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ef09f038-71fd-4144-a4af-8f0a56b9b6d7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:52.275398 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ef09f038-71fd-4144-a4af-8f0a56b9b6d7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:52.303495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-ef09f038-71fd-4144-a4af-8f0a56b9b6d7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lazy-loading 'flavor' on Instance uuid dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:44:52.615237 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-48cbf732-7b0b-4312-9496-b67fe3f10942 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:52.615855 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-48cbf732-7b0b-4312-9496-b67fe3f10942 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:52.626838 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-48cbf732-7b0b-4312-9496-b67fe3f10942 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:52.627320 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-48cbf732-7b0b-4312-9496-b67fe3f10942 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:52.628087 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-48cbf732-7b0b-4312-9496-b67fe3f10942 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:52.628516 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-48cbf732-7b0b-4312-9496-b67fe3f10942 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:52.859199 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-48cbf732-7b0b-4312-9496-b67fe3f10942 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:52.867716 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-48cbf732-7b0b-4312-9496-b67fe3f10942 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:52.869215 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-48cbf732-7b0b-4312-9496-b67fe3f10942 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:52.870375 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-48cbf732-7b0b-4312-9496-b67fe3f10942 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1597 microversion: 2.20 time: 0.260205 Jun 16 19:44:52.871539 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 101/207] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:44:52 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1597 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:44:52.888983 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e505b64f-5d99-46a5-be1b-00aa352735b6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:52.896108 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e505b64f-5d99-46a5-be1b-00aa352735b6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:52.896108 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e505b64f-5d99-46a5-be1b-00aa352735b6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:52.896108 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e505b64f-5d99-46a5-be1b-00aa352735b6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:52.896915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e505b64f-5d99-46a5-be1b-00aa352735b6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:52.897077 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e505b64f-5d99-46a5-be1b-00aa352735b6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:52.927418 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ef09f038-71fd-4144-a4af-8f0a56b9b6d7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "POST /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0/action" status: 200 len: 32 microversion: 2.1 time: 0.667177 Jun 16 19:44:52.927418 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 107/208] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Jun 16 19:44:52 2022] POST /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0/action => generated 32 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 19:44:52.936237 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6d3ac54a-953d-416f-964b-d919c31e974f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:52.937008 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6d3ac54a-953d-416f-964b-d919c31e974f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:52.947969 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6d3ac54a-953d-416f-964b-d919c31e974f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:52.948443 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6d3ac54a-953d-416f-964b-d919c31e974f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:52.949502 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6d3ac54a-953d-416f-964b-d919c31e974f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:52.949942 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6d3ac54a-953d-416f-964b-d919c31e974f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:52.980978 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e505b64f-5d99-46a5-be1b-00aa352735b6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095217 Jun 16 19:44:52.981675 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 102/209] 10.222.0.36 () {60 vars in 1315 bytes} [Thu Jun 16 19:44:52 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 19:44:53.137864 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6d3ac54a-953d-416f-964b-d919c31e974f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:53.145627 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6d3ac54a-953d-416f-964b-d919c31e974f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.215584 Jun 16 19:44:53.146199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 108/210] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:52 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:54.172623 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-840cc888-2935-453c-b552-fb77454a4693 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:54.173300 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-840cc888-2935-453c-b552-fb77454a4693 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:54.180294 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-840cc888-2935-453c-b552-fb77454a4693 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:54.180740 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-840cc888-2935-453c-b552-fb77454a4693 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:54.181611 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-840cc888-2935-453c-b552-fb77454a4693 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:54.182237 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-840cc888-2935-453c-b552-fb77454a4693 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:54.444054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-840cc888-2935-453c-b552-fb77454a4693 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:54.454823 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-840cc888-2935-453c-b552-fb77454a4693 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.294704 Jun 16 19:44:54.459739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 103/211] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:54 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:54.473092 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-b23c8617-044a-44d4-bfa6-f284c89f9327 req-2f6da537-3de2-469e-a9b0-6a3da86ab194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f667dde1-232e-4f14-917f-0a749279d6a8", "tag": "ce7582ec-7186-425a-a407-f177022e1f52"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:44:54.486569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-b23c8617-044a-44d4-bfa6-f284c89f9327 req-2f6da537-3de2-469e-a9b0-6a3da86ab194 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:54.489199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-b23c8617-044a-44d4-bfa6-f284c89f9327 req-2f6da537-3de2-469e-a9b0-6a3da86ab194 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:54.513475 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-b23c8617-044a-44d4-bfa6-f284c89f9327 req-2f6da537-3de2-469e-a9b0-6a3da86ab194 service nova] Creating event network-changed:ce7582ec-7186-425a-a407-f177022e1f52 for instance f667dde1-232e-4f14-917f-0a749279d6a8 on hv-cinder-84617 Jun 16 19:44:54.522994 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-b23c8617-044a-44d4-bfa6-f284c89f9327 req-2f6da537-3de2-469e-a9b0-6a3da86ab194 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052238 Jun 16 19:44:54.523672 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 109/212] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:44:55.475084 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b05ae269-e23d-4e71-bff6-c48e73207d60 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:55.475084 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b05ae269-e23d-4e71-bff6-c48e73207d60 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:55.482941 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b05ae269-e23d-4e71-bff6-c48e73207d60 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:55.483500 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b05ae269-e23d-4e71-bff6-c48e73207d60 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:55.484216 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b05ae269-e23d-4e71-bff6-c48e73207d60 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:55.484799 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b05ae269-e23d-4e71-bff6-c48e73207d60 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:55.628467 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b05ae269-e23d-4e71-bff6-c48e73207d60 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:55.634487 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b05ae269-e23d-4e71-bff6-c48e73207d60 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.164182 Jun 16 19:44:55.635097 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 104/213] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:55 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:56.651765 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b3f124da-ca43-4e37-99e6-1496a7dc06e5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:56.652607 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b3f124da-ca43-4e37-99e6-1496a7dc06e5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:56.659417 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b3f124da-ca43-4e37-99e6-1496a7dc06e5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:56.659867 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b3f124da-ca43-4e37-99e6-1496a7dc06e5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:56.660636 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b3f124da-ca43-4e37-99e6-1496a7dc06e5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:56.661072 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b3f124da-ca43-4e37-99e6-1496a7dc06e5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:56.850616 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b3f124da-ca43-4e37-99e6-1496a7dc06e5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:56.858171 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b3f124da-ca43-4e37-99e6-1496a7dc06e5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.210709 Jun 16 19:44:56.858768 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 110/214] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:56 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:57.875579 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f93209e8-4fa8-4a51-9ff8-8877a305a49b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:57.876770 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f93209e8-4fa8-4a51-9ff8-8877a305a49b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:57.884431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f93209e8-4fa8-4a51-9ff8-8877a305a49b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:57.884880 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f93209e8-4fa8-4a51-9ff8-8877a305a49b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:57.885708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f93209e8-4fa8-4a51-9ff8-8877a305a49b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:57.886162 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f93209e8-4fa8-4a51-9ff8-8877a305a49b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:58.041790 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f93209e8-4fa8-4a51-9ff8-8877a305a49b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:58.049980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f93209e8-4fa8-4a51-9ff8-8877a305a49b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.178854 Jun 16 19:44:58.050481 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 105/215] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:57 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:44:59.069361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-69b1a64e-8c9c-4583-a16f-160afa6394d2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:44:59.070417 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-69b1a64e-8c9c-4583-a16f-160afa6394d2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:44:59.079399 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-69b1a64e-8c9c-4583-a16f-160afa6394d2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:59.079925 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-69b1a64e-8c9c-4583-a16f-160afa6394d2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:59.080759 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-69b1a64e-8c9c-4583-a16f-160afa6394d2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:44:59.081263 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-69b1a64e-8c9c-4583-a16f-160afa6394d2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:44:59.214235 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-69b1a64e-8c9c-4583-a16f-160afa6394d2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:44:59.221693 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-69b1a64e-8c9c-4583-a16f-160afa6394d2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.158543 Jun 16 19:44:59.222253 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 111/216] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:44:59 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:00.238348 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e5e58c36-a368-4a26-bb37-22340c7eda68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:00.239134 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e5e58c36-a368-4a26-bb37-22340c7eda68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:00.245948 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e5e58c36-a368-4a26-bb37-22340c7eda68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:00.246323 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e5e58c36-a368-4a26-bb37-22340c7eda68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:00.247136 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e5e58c36-a368-4a26-bb37-22340c7eda68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:00.247566 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e5e58c36-a368-4a26-bb37-22340c7eda68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:00.373572 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e5e58c36-a368-4a26-bb37-22340c7eda68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:00.381208 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e5e58c36-a368-4a26-bb37-22340c7eda68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.146672 Jun 16 19:45:00.381780 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 106/217] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:00 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:01.398071 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e47e4d7c-91eb-4c27-ad0d-0233003be694 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:01.398672 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e47e4d7c-91eb-4c27-ad0d-0233003be694 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:01.404777 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e47e4d7c-91eb-4c27-ad0d-0233003be694 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:01.405234 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e47e4d7c-91eb-4c27-ad0d-0233003be694 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:01.405967 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e47e4d7c-91eb-4c27-ad0d-0233003be694 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:01.406392 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e47e4d7c-91eb-4c27-ad0d-0233003be694 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:01.574554 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e47e4d7c-91eb-4c27-ad0d-0233003be694 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:01.583069 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e47e4d7c-91eb-4c27-ad0d-0233003be694 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.188745 Jun 16 19:45:01.583845 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 112/218] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:01 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:02.222786 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-ccbb032f-da2d-438f-a8b9-231bdbe47289 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:02.223332 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-ccbb032f-da2d-438f-a8b9-231bdbe47289 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:02.230514 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ccbb032f-da2d-438f-a8b9-231bdbe47289 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:02.230993 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ccbb032f-da2d-438f-a8b9-231bdbe47289 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:02.231752 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ccbb032f-da2d-438f-a8b9-231bdbe47289 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:02.232187 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ccbb032f-da2d-438f-a8b9-231bdbe47289 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:02.257011 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-ccbb032f-da2d-438f-a8b9-231bdbe47289 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Going to try to terminate instance {{(pid=124551) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:45:02.600706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-109a4847-4db6-45ab-bdf7-bddf9ba7119d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:02.601343 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-109a4847-4db6-45ab-bdf7-bddf9ba7119d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:02.607853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-109a4847-4db6-45ab-bdf7-bddf9ba7119d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:02.608303 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-109a4847-4db6-45ab-bdf7-bddf9ba7119d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:02.609066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-109a4847-4db6-45ab-bdf7-bddf9ba7119d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:02.609500 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-109a4847-4db6-45ab-bdf7-bddf9ba7119d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:02.746355 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-109a4847-4db6-45ab-bdf7-bddf9ba7119d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:02.753955 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-109a4847-4db6-45ab-bdf7-bddf9ba7119d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.157058 Jun 16 19:45:02.754512 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 113/219] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:02 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:45:02.845317 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-ccbb032f-da2d-438f-a8b9-231bdbe47289 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 204 len: 0 microversion: 2.1 time: 0.625371 Jun 16 19:45:02.846682 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 107/220] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:45:02 2022] DELETE /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:45:02.868148 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4efc2e59-22de-4e59-9a82-87fe8da43433 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:02.868834 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4efc2e59-22de-4e59-9a82-87fe8da43433 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:02.875395 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4efc2e59-22de-4e59-9a82-87fe8da43433 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:02.875838 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4efc2e59-22de-4e59-9a82-87fe8da43433 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:02.876595 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4efc2e59-22de-4e59-9a82-87fe8da43433 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:02.877025 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4efc2e59-22de-4e59-9a82-87fe8da43433 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:03.012590 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4efc2e59-22de-4e59-9a82-87fe8da43433 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:03.020705 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4efc2e59-22de-4e59-9a82-87fe8da43433 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1555 microversion: 2.1 time: 0.156535 Jun 16 19:45:03.021264 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 114/221] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:02 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:03.771004 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0b326068-10e9-4e6f-8a1b-040c694741c6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:03.771705 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0b326068-10e9-4e6f-8a1b-040c694741c6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:03.774063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:45:03.780053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0b326068-10e9-4e6f-8a1b-040c694741c6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:03.780504 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0b326068-10e9-4e6f-8a1b-040c694741c6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:03.781255 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0b326068-10e9-4e6f-8a1b-040c694741c6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:03.781688 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0b326068-10e9-4e6f-8a1b-040c694741c6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:03.926583 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0b326068-10e9-4e6f-8a1b-040c694741c6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:03.935970 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0b326068-10e9-4e6f-8a1b-040c694741c6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.169210 Jun 16 19:45:03.937749 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 108/222] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:03 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:04.038473 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5669bb82-21fa-4531-878f-e68a5ddd5375 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:04.040264 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5669bb82-21fa-4531-878f-e68a5ddd5375 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:04.047965 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5669bb82-21fa-4531-878f-e68a5ddd5375 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:04.050358 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5669bb82-21fa-4531-878f-e68a5ddd5375 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:04.050358 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5669bb82-21fa-4531-878f-e68a5ddd5375 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:04.050358 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5669bb82-21fa-4531-878f-e68a5ddd5375 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:04.198649 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5669bb82-21fa-4531-878f-e68a5ddd5375 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:04.207753 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5669bb82-21fa-4531-878f-e68a5ddd5375 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1555 microversion: 2.1 time: 0.174083 Jun 16 19:45:04.208322 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 115/223] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:04 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:04.957475 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9dfe9904-7ad4-43f9-af14-f11420ed4c04 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:04.958192 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9dfe9904-7ad4-43f9-af14-f11420ed4c04 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:04.965449 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9dfe9904-7ad4-43f9-af14-f11420ed4c04 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:04.965976 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9dfe9904-7ad4-43f9-af14-f11420ed4c04 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:04.966829 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9dfe9904-7ad4-43f9-af14-f11420ed4c04 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:04.967354 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9dfe9904-7ad4-43f9-af14-f11420ed4c04 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:05.118233 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9dfe9904-7ad4-43f9-af14-f11420ed4c04 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:05.126250 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9dfe9904-7ad4-43f9-af14-f11420ed4c04 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.173007 Jun 16 19:45:05.126828 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 109/224] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:04 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:05.224292 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-567743c7-e546-4854-a31e-d8995b7a1796 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:05.224919 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-567743c7-e546-4854-a31e-d8995b7a1796 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:05.231808 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-567743c7-e546-4854-a31e-d8995b7a1796 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:05.232247 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-567743c7-e546-4854-a31e-d8995b7a1796 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:05.232988 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-567743c7-e546-4854-a31e-d8995b7a1796 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:05.233413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-567743c7-e546-4854-a31e-d8995b7a1796 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:05.364070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-567743c7-e546-4854-a31e-d8995b7a1796 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:05.372302 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-567743c7-e546-4854-a31e-d8995b7a1796 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1555 microversion: 2.1 time: 0.151979 Jun 16 19:45:05.383860 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 116/225] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:05 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:45:06.143232 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6736d498-92a8-4bdd-b4c5-5743654fab4f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:06.143845 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6736d498-92a8-4bdd-b4c5-5743654fab4f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:06.150339 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6736d498-92a8-4bdd-b4c5-5743654fab4f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:06.150789 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6736d498-92a8-4bdd-b4c5-5743654fab4f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:06.151597 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6736d498-92a8-4bdd-b4c5-5743654fab4f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:06.152582 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6736d498-92a8-4bdd-b4c5-5743654fab4f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:06.289248 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6736d498-92a8-4bdd-b4c5-5743654fab4f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:06.298321 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6736d498-92a8-4bdd-b4c5-5743654fab4f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.159191 Jun 16 19:45:06.298891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 110/226] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:06 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:45:06.389549 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4f02cdec-7945-4ad1-b73c-033b082ac9a2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:06.390726 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4f02cdec-7945-4ad1-b73c-033b082ac9a2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:06.397203 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4f02cdec-7945-4ad1-b73c-033b082ac9a2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:06.397758 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4f02cdec-7945-4ad1-b73c-033b082ac9a2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:06.398466 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4f02cdec-7945-4ad1-b73c-033b082ac9a2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:06.398914 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4f02cdec-7945-4ad1-b73c-033b082ac9a2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:06.537630 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4f02cdec-7945-4ad1-b73c-033b082ac9a2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:06.546607 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4f02cdec-7945-4ad1-b73c-033b082ac9a2 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1555 microversion: 2.1 time: 0.161568 Jun 16 19:45:06.547524 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 117/227] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:06 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:07.315918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-ff47a47e-1572-4bc3-b022-4e454aed386c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:07.317128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-ff47a47e-1572-4bc3-b022-4e454aed386c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:07.323852 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ff47a47e-1572-4bc3-b022-4e454aed386c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:07.324424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ff47a47e-1572-4bc3-b022-4e454aed386c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:07.325492 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ff47a47e-1572-4bc3-b022-4e454aed386c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:07.326022 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ff47a47e-1572-4bc3-b022-4e454aed386c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:07.457763 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ff47a47e-1572-4bc3-b022-4e454aed386c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:07.466355 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-ff47a47e-1572-4bc3-b022-4e454aed386c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.154767 Jun 16 19:45:07.466957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 111/228] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:07 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:07.564403 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-40ffbc72-28ae-4913-a6f3-3c422ec7a805 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:07.565144 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-40ffbc72-28ae-4913-a6f3-3c422ec7a805 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:07.571504 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-40ffbc72-28ae-4913-a6f3-3c422ec7a805 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:07.571955 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-40ffbc72-28ae-4913-a6f3-3c422ec7a805 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:07.572723 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-40ffbc72-28ae-4913-a6f3-3c422ec7a805 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:07.573158 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-40ffbc72-28ae-4913-a6f3-3c422ec7a805 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:07.711088 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-40ffbc72-28ae-4913-a6f3-3c422ec7a805 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:07.720216 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-40ffbc72-28ae-4913-a6f3-3c422ec7a805 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1555 microversion: 2.1 time: 0.159601 Jun 16 19:45:07.720798 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 118/229] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:07 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:08.370673 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-5f0bef51-530f-46d2-a5af-d3f148c0069e req-5165d98c-bbb9-40d5-a689-f60fefebb011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7105897-838f-4c95-ae60-85519aedc5f4", "name": "network-vif-deleted", "tag": "9e5ad711-50b7-4712-b146-3a4866c32613"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:45:08.381623 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-5f0bef51-530f-46d2-a5af-d3f148c0069e req-5165d98c-bbb9-40d5-a689-f60fefebb011 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:08.382059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-5f0bef51-530f-46d2-a5af-d3f148c0069e req-5165d98c-bbb9-40d5-a689-f60fefebb011 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:08.396464 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-5f0bef51-530f-46d2-a5af-d3f148c0069e req-5165d98c-bbb9-40d5-a689-f60fefebb011 service nova] Creating event network-vif-deleted:9e5ad711-50b7-4712-b146-3a4866c32613 for instance f7105897-838f-4c95-ae60-85519aedc5f4 on hv-cinder-84617 Jun 16 19:45:08.417061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-5f0bef51-530f-46d2-a5af-d3f148c0069e req-5165d98c-bbb9-40d5-a689-f60fefebb011 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052005 Jun 16 19:45:08.422586 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 112/230] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:45:08.497869 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3eac2a7f-e431-431a-ab04-7db3535836e5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:08.497869 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3eac2a7f-e431-431a-ab04-7db3535836e5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:08.503620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3eac2a7f-e431-431a-ab04-7db3535836e5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:08.504074 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3eac2a7f-e431-431a-ab04-7db3535836e5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:08.504852 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3eac2a7f-e431-431a-ab04-7db3535836e5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:08.505289 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3eac2a7f-e431-431a-ab04-7db3535836e5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:08.737944 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d82912a2-4cb1-44b0-b2d9-09ba95f94c33 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:08.738632 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d82912a2-4cb1-44b0-b2d9-09ba95f94c33 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:08.745244 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d82912a2-4cb1-44b0-b2d9-09ba95f94c33 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:08.745686 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d82912a2-4cb1-44b0-b2d9-09ba95f94c33 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:08.746456 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d82912a2-4cb1-44b0-b2d9-09ba95f94c33 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:08.750703 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d82912a2-4cb1-44b0-b2d9-09ba95f94c33 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:08.762521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:45:08.820097 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d82912a2-4cb1-44b0-b2d9-09ba95f94c33 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:08.829064 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d82912a2-4cb1-44b0-b2d9-09ba95f94c33 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1346 microversion: 2.1 time: 0.095329 Jun 16 19:45:08.838255 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 113/231] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:08 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1346 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:45:08.926258 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3eac2a7f-e431-431a-ab04-7db3535836e5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:08.934092 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3eac2a7f-e431-431a-ab04-7db3535836e5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.447417 Jun 16 19:45:08.934732 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 119/232] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:08 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:09.845938 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9ec194a4-aad9-4677-a1c3-db2cf61bf2cc tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:09.846663 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9ec194a4-aad9-4677-a1c3-db2cf61bf2cc tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:09.853573 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9ec194a4-aad9-4677-a1c3-db2cf61bf2cc tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:09.854022 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9ec194a4-aad9-4677-a1c3-db2cf61bf2cc tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:09.861084 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9ec194a4-aad9-4677-a1c3-db2cf61bf2cc tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:09.861084 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9ec194a4-aad9-4677-a1c3-db2cf61bf2cc tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:09.918612 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9ec194a4-aad9-4677-a1c3-db2cf61bf2cc tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:09.926450 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9ec194a4-aad9-4677-a1c3-db2cf61bf2cc tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1346 microversion: 2.1 time: 0.084862 Jun 16 19:45:09.927030 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 114/233] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:09 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:09.953422 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-917be80d-9dae-4fe6-9775-bec4c9eecfb9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:09.953918 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-917be80d-9dae-4fe6-9775-bec4c9eecfb9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:09.960099 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-917be80d-9dae-4fe6-9775-bec4c9eecfb9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:09.960547 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-917be80d-9dae-4fe6-9775-bec4c9eecfb9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:09.961308 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-917be80d-9dae-4fe6-9775-bec4c9eecfb9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:09.961741 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-917be80d-9dae-4fe6-9775-bec4c9eecfb9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:10.088381 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-917be80d-9dae-4fe6-9775-bec4c9eecfb9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:10.095886 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-917be80d-9dae-4fe6-9775-bec4c9eecfb9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.146471 Jun 16 19:45:10.096451 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 120/234] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:09 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:10.943469 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e1e2bc56-6cf9-402d-882a-bb184d89e104 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:10.944001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e1e2bc56-6cf9-402d-882a-bb184d89e104 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:10.951362 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e1e2bc56-6cf9-402d-882a-bb184d89e104 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:10.951816 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e1e2bc56-6cf9-402d-882a-bb184d89e104 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:10.952564 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e1e2bc56-6cf9-402d-882a-bb184d89e104 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:10.952997 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e1e2bc56-6cf9-402d-882a-bb184d89e104 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:11.113402 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0e58e329-0920-4fad-b6ed-843fb1bdffaf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:11.114105 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0e58e329-0920-4fad-b6ed-843fb1bdffaf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:11.120283 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e58e329-0920-4fad-b6ed-843fb1bdffaf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:11.121347 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e58e329-0920-4fad-b6ed-843fb1bdffaf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:11.122278 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e58e329-0920-4fad-b6ed-843fb1bdffaf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:11.122719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e58e329-0920-4fad-b6ed-843fb1bdffaf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:11.126834 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:45:11.151675 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e1e2bc56-6cf9-402d-882a-bb184d89e104 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:11.159869 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e1e2bc56-6cf9-402d-882a-bb184d89e104 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1346 microversion: 2.1 time: 0.220283 Jun 16 19:45:11.160446 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 115/235] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:10 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1346 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:11.270108 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0e58e329-0920-4fad-b6ed-843fb1bdffaf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:11.278023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0e58e329-0920-4fad-b6ed-843fb1bdffaf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.168840 Jun 16 19:45:11.278578 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 121/236] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:11 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:45:12.176954 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-fe3ad6d2-a1e9-445d-8ea3-0dddabe26609 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:12.177568 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-fe3ad6d2-a1e9-445d-8ea3-0dddabe26609 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:12.184262 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fe3ad6d2-a1e9-445d-8ea3-0dddabe26609 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:12.184716 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fe3ad6d2-a1e9-445d-8ea3-0dddabe26609 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:12.185471 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fe3ad6d2-a1e9-445d-8ea3-0dddabe26609 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:12.185904 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fe3ad6d2-a1e9-445d-8ea3-0dddabe26609 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:12.247447 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-fe3ad6d2-a1e9-445d-8ea3-0dddabe26609 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:12.255694 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-fe3ad6d2-a1e9-445d-8ea3-0dddabe26609 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1346 microversion: 2.1 time: 0.082527 Jun 16 19:45:12.256496 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 116/237] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:12 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:12.294870 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c181caa8-5bed-44aa-b845-3b8fd8a08d22 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:12.295534 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c181caa8-5bed-44aa-b845-3b8fd8a08d22 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:12.297412 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=65 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:45:12.302449 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c181caa8-5bed-44aa-b845-3b8fd8a08d22 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:12.302897 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c181caa8-5bed-44aa-b845-3b8fd8a08d22 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:12.303732 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c181caa8-5bed-44aa-b845-3b8fd8a08d22 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:12.304169 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c181caa8-5bed-44aa-b845-3b8fd8a08d22 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:12.433274 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c181caa8-5bed-44aa-b845-3b8fd8a08d22 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:12.440843 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c181caa8-5bed-44aa-b845-3b8fd8a08d22 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.150136 Jun 16 19:45:12.441410 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 122/238] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:12 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:13.272815 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7c5aff0d-1928-4586-8e42-dd9242cc2c02 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:13.273397 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-7c5aff0d-1928-4586-8e42-dd9242cc2c02 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:13.282031 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7c5aff0d-1928-4586-8e42-dd9242cc2c02 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:13.282479 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7c5aff0d-1928-4586-8e42-dd9242cc2c02 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:13.288150 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7c5aff0d-1928-4586-8e42-dd9242cc2c02 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:13.288150 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7c5aff0d-1928-4586-8e42-dd9242cc2c02 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:13.324986 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7c5aff0d-1928-4586-8e42-dd9242cc2c02 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:13.325434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7c5aff0d-1928-4586-8e42-dd9242cc2c02 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:13.325902 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-7c5aff0d-1928-4586-8e42-dd9242cc2c02 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lazy-loading 'fault' on Instance uuid f7105897-838f-4c95-ae60-85519aedc5f4 {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:45:13.374468 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-7c5aff0d-1928-4586-8e42-dd9242cc2c02 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9320ca5b2a9499a86d5614b55eddede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5544755ae458477d88d411b080a2517a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:13.381407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-7c5aff0d-1928-4586-8e42-dd9242cc2c02 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 200 len: 1305 microversion: 2.1 time: 0.112533 Jun 16 19:45:13.381960 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 117/239] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:13 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 1305 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:13.460594 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-723ab8db-eb67-477b-8325-9ed0a148615d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:13.461372 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-723ab8db-eb67-477b-8325-9ed0a148615d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:13.470810 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-723ab8db-eb67-477b-8325-9ed0a148615d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:13.472949 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-723ab8db-eb67-477b-8325-9ed0a148615d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:13.472949 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-723ab8db-eb67-477b-8325-9ed0a148615d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:13.473574 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-723ab8db-eb67-477b-8325-9ed0a148615d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:13.624612 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-723ab8db-eb67-477b-8325-9ed0a148615d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:13.631985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-723ab8db-eb67-477b-8325-9ed0a148615d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.178312 Jun 16 19:45:13.632567 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 123/240] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:13 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:14.398209 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-300c7fcd-5294-413c-843d-a67fc51b0fe4 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:14.399127 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-300c7fcd-5294-413c-843d-a67fc51b0fe4 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:14.406769 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-300c7fcd-5294-413c-843d-a67fc51b0fe4 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:14.407250 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-300c7fcd-5294-413c-843d-a67fc51b0fe4 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:14.408108 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-300c7fcd-5294-413c-843d-a67fc51b0fe4 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:14.408647 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-300c7fcd-5294-413c-843d-a67fc51b0fe4 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:14.423260 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-300c7fcd-5294-413c-843d-a67fc51b0fe4 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] HTTP exception thrown: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-300c7fcd-5294-413c-843d-a67fc51b0fe4 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Request method failure captured: Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 HTTP/1.1 Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4f0tYOkMyGu5c_Jd6b_De7NmZHr2Ad-6mXZpFUKbStwqn18hnSAC11PYzX9PO8Tmda6fLvWHhzyHzC5BybO8GOnj454OgBGzE4fRkN1_yVRqFXrSj-MgoTxGyLOfZNPySw97O5xZKjTh2KKz7feRPbl2cOUHNpemn0JWDQTE1pXMD4 Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 5544755ae458477d88d411b080a2517a Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-DeleteServersTestJSON-978771640 Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:45:14.428407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:45:14.429638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5544755ae458477d88d411b080a2517a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5544755ae458477d88d411b080a2517a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5544755ae458477d88d411b080a2517a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5544755ae458477d88d411b080a2517a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:45:14.429638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-DeleteServersTestJSON-978771640 Jun 16 19:45:14.429638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 5544755ae458477d88d411b080a2517a Jun 16 19:45:14.429638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-DeleteServersTestJSON-978771640 Jun 16 19:45:14.429638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-DeleteServersTestJSON-978771640-project Jun 16 19:45:14.429638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:45:14.429638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:45:14.429638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: d9320ca5b2a9499a86d5614b55eddede Jun 16 19:45:14.429638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-DeleteServersTestJSON-978771640-project Jun 16 19:45:14.429638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:45:14.429638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:14.429638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': 'f7105897-838f-4c95-ae60-85519aedc5f4'} Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:45:14.430343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:45:14.435541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:45:14.435541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:45:14.435541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:45:14.435541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:45:14.435541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:45:14.435541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:45:14.435541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:45:14.435541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:14.435541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:14.435541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:45:14.435541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:14.435541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:45:14.435541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:45:14.435541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:45:14.435541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:45:14.435541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:45:14.435541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:14.435541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:14.437217 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-300c7fcd-5294-413c-843d-a67fc51b0fe4 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Returning 404 to user: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:45:14.437217 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-300c7fcd-5294-413c-843d-a67fc51b0fe4 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 404 len: 111 microversion: 2.1 time: 0.036024 Jun 16 19:45:14.437217 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 118/241] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:14 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:45:14.649402 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-86201fb2-c960-4324-b3bf-64b202a00ad7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:14.650017 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-86201fb2-c960-4324-b3bf-64b202a00ad7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:14.656757 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86201fb2-c960-4324-b3bf-64b202a00ad7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:14.659990 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86201fb2-c960-4324-b3bf-64b202a00ad7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:14.659990 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86201fb2-c960-4324-b3bf-64b202a00ad7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:14.659990 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86201fb2-c960-4324-b3bf-64b202a00ad7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:14.789821 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-86201fb2-c960-4324-b3bf-64b202a00ad7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:14.797889 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-86201fb2-c960-4324-b3bf-64b202a00ad7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.152436 Jun 16 19:45:14.798448 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 124/242] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:14 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:14.898908 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1fa01490-8278-46d9-ab6d-a59555460583 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:14.900208 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-1fa01490-8278-46d9-ab6d-a59555460583 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:14.910801 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1fa01490-8278-46d9-ab6d-a59555460583 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:14.912089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1fa01490-8278-46d9-ab6d-a59555460583 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:14.913081 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1fa01490-8278-46d9-ab6d-a59555460583 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:14.913723 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1fa01490-8278-46d9-ab6d-a59555460583 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:14.937988 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-1fa01490-8278-46d9-ab6d-a59555460583 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] HTTP exception thrown: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1fa01490-8278-46d9-ab6d-a59555460583 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Request method failure captured: Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4/os-volume_attachments HTTP/1.1 Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4f0tYOkMyGu5c_Jd6b_De7NmZHr2Ad-6mXZpFUKbStwqn18hnSAC11PYzX9PO8Tmda6fLvWHhzyHzC5BybO8GOnj454OgBGzE4fRkN1_yVRqFXrSj-MgoTxGyLOfZNPySw97O5xZKjTh2KKz7feRPbl2cOUHNpemn0JWDQTE1pXMD4 Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 5544755ae458477d88d411b080a2517a Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-DeleteServersTestJSON-978771640 Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:45:14.940257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:45:14.941553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5544755ae458477d88d411b080a2517a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5544755ae458477d88d411b080a2517a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5544755ae458477d88d411b080a2517a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5544755ae458477d88d411b080a2517a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:45:14.941553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-DeleteServersTestJSON-978771640 Jun 16 19:45:14.941553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 5544755ae458477d88d411b080a2517a Jun 16 19:45:14.941553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-DeleteServersTestJSON-978771640 Jun 16 19:45:14.941553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-DeleteServersTestJSON-978771640-project Jun 16 19:45:14.941553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:45:14.941553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:45:14.941553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: d9320ca5b2a9499a86d5614b55eddede Jun 16 19:45:14.941553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-DeleteServersTestJSON-978771640-project Jun 16 19:45:14.941553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:45:14.941553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:14.941553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'server_id': 'f7105897-838f-4c95-ae60-85519aedc5f4'} Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:45:14.942218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:14.943465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:14.946351 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1fa01490-8278-46d9-ab6d-a59555460583 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Returning 404 to user: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:45:14.947433 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-1fa01490-8278-46d9-ab6d-a59555460583 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.052793 Jun 16 19:45:14.948196 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 119/243] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:45:14 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4/os-volume_attachments => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:45:15.814492 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e707ec37-9a7f-487d-8b68-1d48107a3d19 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:15.815207 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e707ec37-9a7f-487d-8b68-1d48107a3d19 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:15.822055 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e707ec37-9a7f-487d-8b68-1d48107a3d19 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:15.822808 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e707ec37-9a7f-487d-8b68-1d48107a3d19 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:15.824201 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e707ec37-9a7f-487d-8b68-1d48107a3d19 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:15.829862 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e707ec37-9a7f-487d-8b68-1d48107a3d19 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:15.956941 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e707ec37-9a7f-487d-8b68-1d48107a3d19 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:15.964680 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e707ec37-9a7f-487d-8b68-1d48107a3d19 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.153924 Jun 16 19:45:15.965245 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 125/244] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:15 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:16.353825 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-26e3641c-20ee-4d06-95a8-96d933216d29 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:16.354939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-26e3641c-20ee-4d06-95a8-96d933216d29 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:16.362590 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-26e3641c-20ee-4d06-95a8-96d933216d29 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:16.362590 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-26e3641c-20ee-4d06-95a8-96d933216d29 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:16.362590 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-26e3641c-20ee-4d06-95a8-96d933216d29 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:16.363069 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-26e3641c-20ee-4d06-95a8-96d933216d29 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:16.377883 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-26e3641c-20ee-4d06-95a8-96d933216d29 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] HTTP exception thrown: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-26e3641c-20ee-4d06-95a8-96d933216d29 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Request method failure captured: Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: DELETE /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 HTTP/1.1 Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4f0tYOkMyGu5c_Jd6b_De7NmZHr2Ad-6mXZpFUKbStwqn18hnSAC11PYzX9PO8Tmda6fLvWHhzyHzC5BybO8GOnj454OgBGzE4fRkN1_yVRqFXrSj-MgoTxGyLOfZNPySw97O5xZKjTh2KKz7feRPbl2cOUHNpemn0JWDQTE1pXMD4 Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 5544755ae458477d88d411b080a2517a Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-DeleteServersTestJSON-978771640 Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:45:16.379423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:45:16.380794 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5544755ae458477d88d411b080a2517a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5544755ae458477d88d411b080a2517a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5544755ae458477d88d411b080a2517a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5544755ae458477d88d411b080a2517a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:45:16.380794 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-DeleteServersTestJSON-978771640 Jun 16 19:45:16.380794 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 5544755ae458477d88d411b080a2517a Jun 16 19:45:16.380794 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-DeleteServersTestJSON-978771640 Jun 16 19:45:16.380794 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-DeleteServersTestJSON-978771640-project Jun 16 19:45:16.380794 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:45:16.380794 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:45:16.380794 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: d9320ca5b2a9499a86d5614b55eddede Jun 16 19:45:16.380794 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-DeleteServersTestJSON-978771640-project Jun 16 19:45:16.380794 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:45:16.380794 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:16.380794 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': 'f7105897-838f-4c95-ae60-85519aedc5f4'} Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:45:16.381672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:16.382735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:16.383832 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-26e3641c-20ee-4d06-95a8-96d933216d29 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Returning 404 to user: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:45:16.383832 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-26e3641c-20ee-4d06-95a8-96d933216d29 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 404 len: 111 microversion: 2.1 time: 0.030916 Jun 16 19:45:16.383832 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 120/245] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:45:16 2022] DELETE /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:45:16.389444 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cfcbaa29-8225-4294-8055-4be064c88df5 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:16.390053 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-cfcbaa29-8225-4294-8055-4be064c88df5 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] [instance: f7105897-838f-4c95-ae60-85519aedc5f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:16.396130 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cfcbaa29-8225-4294-8055-4be064c88df5 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:16.396579 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cfcbaa29-8225-4294-8055-4be064c88df5 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:16.397332 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cfcbaa29-8225-4294-8055-4be064c88df5 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:16.397768 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cfcbaa29-8225-4294-8055-4be064c88df5 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:16.411043 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-cfcbaa29-8225-4294-8055-4be064c88df5 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] HTTP exception thrown: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cfcbaa29-8225-4294-8055-4be064c88df5 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Request method failure captured: Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 HTTP/1.1 Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4f0tYOkMyGu5c_Jd6b_De7NmZHr2Ad-6mXZpFUKbStwqn18hnSAC11PYzX9PO8Tmda6fLvWHhzyHzC5BybO8GOnj454OgBGzE4fRkN1_yVRqFXrSj-MgoTxGyLOfZNPySw97O5xZKjTh2KKz7feRPbl2cOUHNpemn0JWDQTE1pXMD4 Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 5544755ae458477d88d411b080a2517a Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-DeleteServersTestJSON-978771640 Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:45:16.415586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:45:16.417577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5544755ae458477d88d411b080a2517a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5544755ae458477d88d411b080a2517a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5544755ae458477d88d411b080a2517a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5544755ae458477d88d411b080a2517a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:45:16.417577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-DeleteServersTestJSON-978771640 Jun 16 19:45:16.417577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 5544755ae458477d88d411b080a2517a Jun 16 19:45:16.417577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-DeleteServersTestJSON-978771640 Jun 16 19:45:16.417577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-DeleteServersTestJSON-978771640-project Jun 16 19:45:16.417577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:45:16.417577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:45:16.417577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: d9320ca5b2a9499a86d5614b55eddede Jun 16 19:45:16.417577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-DeleteServersTestJSON-978771640-project Jun 16 19:45:16.417577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:45:16.417577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:16.417577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': 'f7105897-838f-4c95-ae60-85519aedc5f4'} Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:45:16.418413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:45:16.419816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:45:16.419816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:45:16.419816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:45:16.419816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:45:16.419816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:45:16.419816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:45:16.419816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:45:16.419816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:16.419816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:45:16.419816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:45:16.419816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:45:16.419816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:45:16.419816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:45:16.419816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:45:16.419816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:45:16.419816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:45:16.419816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. Jun 16 19:45:16.419816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:45:16.421032 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cfcbaa29-8225-4294-8055-4be064c88df5 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] Returning 404 to user: Instance f7105897-838f-4c95-ae60-85519aedc5f4 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:45:16.421032 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cfcbaa29-8225-4294-8055-4be064c88df5 tempest-DeleteServersTestJSON-978771640 tempest-DeleteServersTestJSON-978771640-project] 10.222.0.36 "GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4" status: 404 len: 111 microversion: 2.1 time: 0.031428 Jun 16 19:45:16.421032 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 126/246] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:16 2022] GET /compute/v2.1/servers/f7105897-838f-4c95-ae60-85519aedc5f4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:45:16.982829 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c319a706-a221-4913-abdf-90dc8e9436dd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:16.983749 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c319a706-a221-4913-abdf-90dc8e9436dd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:16.991289 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c319a706-a221-4913-abdf-90dc8e9436dd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:16.991742 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c319a706-a221-4913-abdf-90dc8e9436dd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:16.992921 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c319a706-a221-4913-abdf-90dc8e9436dd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:16.992921 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c319a706-a221-4913-abdf-90dc8e9436dd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:17.229925 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c319a706-a221-4913-abdf-90dc8e9436dd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:17.240322 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c319a706-a221-4913-abdf-90dc8e9436dd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.261342 Jun 16 19:45:17.240916 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 121/247] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:16 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:18.257890 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-07450521-8949-46c3-bbf1-38dc3982b9a2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:18.258550 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-07450521-8949-46c3-bbf1-38dc3982b9a2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:18.265311 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-07450521-8949-46c3-bbf1-38dc3982b9a2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:18.265765 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-07450521-8949-46c3-bbf1-38dc3982b9a2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:18.266541 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-07450521-8949-46c3-bbf1-38dc3982b9a2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:18.266999 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-07450521-8949-46c3-bbf1-38dc3982b9a2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:18.481017 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-07450521-8949-46c3-bbf1-38dc3982b9a2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:18.493342 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-07450521-8949-46c3-bbf1-38dc3982b9a2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.239362 Jun 16 19:45:18.496917 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 127/248] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:18 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:19.524440 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-81308d7e-c54c-4747-be15-a0df63c6d3d1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:19.525765 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-81308d7e-c54c-4747-be15-a0df63c6d3d1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:19.534074 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-81308d7e-c54c-4747-be15-a0df63c6d3d1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:19.534564 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-81308d7e-c54c-4747-be15-a0df63c6d3d1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:19.535432 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-81308d7e-c54c-4747-be15-a0df63c6d3d1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:19.535863 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-81308d7e-c54c-4747-be15-a0df63c6d3d1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:19.813585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-81308d7e-c54c-4747-be15-a0df63c6d3d1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:19.822326 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-81308d7e-c54c-4747-be15-a0df63c6d3d1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.312534 Jun 16 19:45:19.823835 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 122/249] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:19 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:20.844015 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ad6976cc-3dfd-4ab7-aa97-ad896335ae86 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:20.846202 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ad6976cc-3dfd-4ab7-aa97-ad896335ae86 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:20.852198 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad6976cc-3dfd-4ab7-aa97-ad896335ae86 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:20.852674 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad6976cc-3dfd-4ab7-aa97-ad896335ae86 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:20.854036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad6976cc-3dfd-4ab7-aa97-ad896335ae86 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:20.855037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad6976cc-3dfd-4ab7-aa97-ad896335ae86 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:21.049001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ad6976cc-3dfd-4ab7-aa97-ad896335ae86 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:21.063292 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ad6976cc-3dfd-4ab7-aa97-ad896335ae86 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.225198 Jun 16 19:45:21.067546 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 128/250] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:20 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:22.081521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-caf75f48-9fcd-4563-a9f6-3d6fe10f9b0a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:22.082146 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-caf75f48-9fcd-4563-a9f6-3d6fe10f9b0a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:22.089521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-caf75f48-9fcd-4563-a9f6-3d6fe10f9b0a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:22.090005 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-caf75f48-9fcd-4563-a9f6-3d6fe10f9b0a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:22.090801 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-caf75f48-9fcd-4563-a9f6-3d6fe10f9b0a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:22.091277 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-caf75f48-9fcd-4563-a9f6-3d6fe10f9b0a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:22.234940 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-caf75f48-9fcd-4563-a9f6-3d6fe10f9b0a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:22.242757 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-caf75f48-9fcd-4563-a9f6-3d6fe10f9b0a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.165148 Jun 16 19:45:22.243550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 123/251] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:22 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:23.260671 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4591a124-8fe9-4a98-b8f6-fd6e85eb93b0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:23.261283 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4591a124-8fe9-4a98-b8f6-fd6e85eb93b0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:23.268029 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4591a124-8fe9-4a98-b8f6-fd6e85eb93b0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:23.268688 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4591a124-8fe9-4a98-b8f6-fd6e85eb93b0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:23.269467 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4591a124-8fe9-4a98-b8f6-fd6e85eb93b0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:23.269988 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4591a124-8fe9-4a98-b8f6-fd6e85eb93b0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:23.410655 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4591a124-8fe9-4a98-b8f6-fd6e85eb93b0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:23.418827 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4591a124-8fe9-4a98-b8f6-fd6e85eb93b0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.162210 Jun 16 19:45:23.419422 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 129/252] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:23 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:24.435602 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c606297b-a17f-4920-8f69-ac4f73f6f626 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:24.437777 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c606297b-a17f-4920-8f69-ac4f73f6f626 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:24.444962 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c606297b-a17f-4920-8f69-ac4f73f6f626 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:24.445427 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c606297b-a17f-4920-8f69-ac4f73f6f626 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:24.446457 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c606297b-a17f-4920-8f69-ac4f73f6f626 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:24.446781 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c606297b-a17f-4920-8f69-ac4f73f6f626 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:24.603797 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c606297b-a17f-4920-8f69-ac4f73f6f626 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:24.613206 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c606297b-a17f-4920-8f69-ac4f73f6f626 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.181269 Jun 16 19:45:24.622811 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 124/253] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:24 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:25.630005 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fa3154a7-4ef2-41e7-861c-b481c2605fd6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:25.630612 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fa3154a7-4ef2-41e7-861c-b481c2605fd6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:25.636530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa3154a7-4ef2-41e7-861c-b481c2605fd6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:25.636978 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa3154a7-4ef2-41e7-861c-b481c2605fd6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:25.637832 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa3154a7-4ef2-41e7-861c-b481c2605fd6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:25.638351 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa3154a7-4ef2-41e7-861c-b481c2605fd6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:25.788949 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fa3154a7-4ef2-41e7-861c-b481c2605fd6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:25.797260 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fa3154a7-4ef2-41e7-861c-b481c2605fd6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.170975 Jun 16 19:45:25.803477 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 130/254] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:25 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:26.659006 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5c189c6c-0b01-469a-a50f-c809e523972f tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] Calling method '.version_select at 0x7f0501618820>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:26.708594 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5c189c6c-0b01-469a-a50f-c809e523972f tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/14b608a4-bfba-4ff9-924b-ae882b6408fb" status: 200 len: 351 microversion: 2.1 time: 0.053900 Jun 16 19:45:26.709364 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 125/255] 10.222.0.36 () {58 vars in 1244 bytes} [Thu Jun 16 19:45:26 2022] GET /compute/v2.1/os-volumes/14b608a4-bfba-4ff9-924b-ae882b6408fb => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:45:26.814402 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ec06855a-0d03-4786-bb99-e7b01612c1a3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:26.815172 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ec06855a-0d03-4786-bb99-e7b01612c1a3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:26.821339 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec06855a-0d03-4786-bb99-e7b01612c1a3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:26.821790 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec06855a-0d03-4786-bb99-e7b01612c1a3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:26.822553 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec06855a-0d03-4786-bb99-e7b01612c1a3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:26.823008 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec06855a-0d03-4786-bb99-e7b01612c1a3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:27.019372 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ec06855a-0d03-4786-bb99-e7b01612c1a3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:27.037038 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ec06855a-0d03-4786-bb99-e7b01612c1a3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.226851 Jun 16 19:45:27.037639 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 131/256] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:26 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:45:28.054123 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-193bce2e-5d0c-46fe-9199-4e4dbf01449a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:28.054879 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-193bce2e-5d0c-46fe-9199-4e4dbf01449a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:28.061287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-193bce2e-5d0c-46fe-9199-4e4dbf01449a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:28.061734 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-193bce2e-5d0c-46fe-9199-4e4dbf01449a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:28.062521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-193bce2e-5d0c-46fe-9199-4e4dbf01449a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:28.062979 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-193bce2e-5d0c-46fe-9199-4e4dbf01449a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:28.216742 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-193bce2e-5d0c-46fe-9199-4e4dbf01449a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:28.216742 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-193bce2e-5d0c-46fe-9199-4e4dbf01449a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.163734 Jun 16 19:45:28.216742 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 126/257] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:28 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:29.231448 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e684c0cb-b500-4839-9a31-85be52f247df tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:29.232033 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e684c0cb-b500-4839-9a31-85be52f247df tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:29.238656 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e684c0cb-b500-4839-9a31-85be52f247df tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:29.239161 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e684c0cb-b500-4839-9a31-85be52f247df tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:29.239894 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e684c0cb-b500-4839-9a31-85be52f247df tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:29.240354 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e684c0cb-b500-4839-9a31-85be52f247df tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:29.383088 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e684c0cb-b500-4839-9a31-85be52f247df tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:29.390641 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e684c0cb-b500-4839-9a31-85be52f247df tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1521 microversion: 2.1 time: 0.162987 Jun 16 19:45:29.391231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 132/258] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:29 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:29.507444 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-2f11abdb-2d26-4b61-a631-071ca4666acd tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] Calling method '.version_select at 0x7f0501785280>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:29.556771 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-2f11abdb-2d26-4b61-a631-071ca4666acd tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/5ffcae1b-0ff4-4051-ad4b-8676262fd958" status: 200 len: 351 microversion: 2.1 time: 0.052998 Jun 16 19:45:29.557339 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 127/259] 10.222.0.36 () {58 vars in 1244 bytes} [Thu Jun 16 19:45:29 2022] GET /compute/v2.1/os-volumes/5ffcae1b-0ff4-4051-ad4b-8676262fd958 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:45:30.420029 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e80356e1-ada1-4fb0-8a75-824d15844d10 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:30.422730 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e80356e1-ada1-4fb0-8a75-824d15844d10 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:30.429341 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e80356e1-ada1-4fb0-8a75-824d15844d10 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:30.430266 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e80356e1-ada1-4fb0-8a75-824d15844d10 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:30.442706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e80356e1-ada1-4fb0-8a75-824d15844d10 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:30.442706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e80356e1-ada1-4fb0-8a75-824d15844d10 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:30.606908 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e80356e1-ada1-4fb0-8a75-824d15844d10 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:30.616854 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e80356e1-ada1-4fb0-8a75-824d15844d10 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1501 microversion: 2.1 time: 0.208949 Jun 16 19:45:30.627918 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 133/260] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:30 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1501 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:30.633969 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a2224da4-9779-442a-943b-3fad4fd48c15 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:30.634542 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a2224da4-9779-442a-943b-3fad4fd48c15 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:30.643964 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a2224da4-9779-442a-943b-3fad4fd48c15 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:30.644454 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a2224da4-9779-442a-943b-3fad4fd48c15 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:30.645241 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a2224da4-9779-442a-943b-3fad4fd48c15 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:30.645661 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a2224da4-9779-442a-943b-3fad4fd48c15 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:30.787515 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a2224da4-9779-442a-943b-3fad4fd48c15 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:30.795084 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a2224da4-9779-442a-943b-3fad4fd48c15 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1515 microversion: 2.1 time: 0.165626 Jun 16 19:45:30.795655 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 128/261] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:30 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:45:31.825279 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8c972a14-e285-4d33-aa9a-1f9423a5a724 tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] Calling method '.version_select at 0x7f05015b1310>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:31.893576 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8c972a14-e285-4d33-aa9a-1f9423a5a724 tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/cc623a5c-be1d-4977-9e29-b52a5d5a2519" status: 200 len: 351 microversion: 2.1 time: 0.072366 Jun 16 19:45:31.894150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 134/262] 10.222.0.36 () {58 vars in 1244 bytes} [Thu Jun 16 19:45:31 2022] GET /compute/v2.1/os-volumes/cc623a5c-be1d-4977-9e29-b52a5d5a2519 => generated 351 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:45:31.905733 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-16c43d2a-1d7d-4c0d-b62a-f93d98eb6ea4 tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] Calling method '.version_select at 0x7f05016189d0>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:32.100366 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-16c43d2a-1d7d-4c0d-b62a-f93d98eb6ea4 tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.198868 Jun 16 19:45:32.100982 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 129/263] 10.222.0.36 () {58 vars in 1133 bytes} [Thu Jun 16 19:45:31 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:32.115539 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-05a8223f-2a13-4cc0-90ae-e86b27813223 tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] Calling method '.version_select at 0x7f05015b1c10>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:32.209628 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-05a8223f-2a13-4cc0-90ae-e86b27813223 tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.098985 Jun 16 19:45:32.210430 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 135/264] 10.222.0.36 () {58 vars in 1148 bytes} [Thu Jun 16 19:45:32 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:45:32.223478 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-dbddf633-34c8-4fc8-8877-f025a84e7430 tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] Calling method '.version_select at 0x7f050173ab80>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:32.384600 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-dbddf633-34c8-4fc8-8877-f025a84e7430 tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.165083 Jun 16 19:45:32.385164 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 130/265] 10.222.0.36 () {58 vars in 1133 bytes} [Thu Jun 16 19:45:32 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:32.396609 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9c705ae5-07cb-4695-bab7-fb018818b9e5 tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] Calling method '.version_select at 0x7f05015c8670>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:32.493795 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9c705ae5-07cb-4695-bab7-fb018818b9e5 tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.100854 Jun 16 19:45:32.494372 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 136/266] 10.222.0.36 () {58 vars in 1166 bytes} [Thu Jun 16 19:45:32 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:45:32.510086 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-956e6c70-c4ad-47a6-954c-892b644957d2 tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] Calling method '.version_select at 0x7f0501785f70>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:32.616017 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-956e6c70-c4ad-47a6-954c-892b644957d2 tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.110586 Jun 16 19:45:32.616610 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 131/267] 10.222.0.36 () {58 vars in 1169 bytes} [Thu Jun 16 19:45:32 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:45:32.629804 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-71e79cbf-ac01-4b15-bdea-754d2cbf87b2 tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] Calling method '.version_select at 0x7f05015c8d30>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:32.712224 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-71e79cbf-ac01-4b15-bdea-754d2cbf87b2 tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.085860 Jun 16 19:45:32.713350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 137/268] 10.222.0.36 () {58 vars in 1154 bytes} [Thu Jun 16 19:45:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:32.724162 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6ec19583-1a0e-4ae0-a5b0-0482b524e252 tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] Calling method '.version_select at 0x7f050173aee0>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:32.828464 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6ec19583-1a0e-4ae0-a5b0-0482b524e252 tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.107937 Jun 16 19:45:32.829042 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 132/269] 10.222.0.36 () {58 vars in 1187 bytes} [Thu Jun 16 19:45:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:45:32.844424 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-17262454-7854-4ab1-b3fe-6731667c731c tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] Calling method '.version_select at 0x7f05015c80d0>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:32.922066 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-66a098fd-1c63-46f6-9993-ebaa06ee5309 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:45:32.923473 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-66a098fd-1c63-46f6-9993-ebaa06ee5309 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:32.942420 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-66a098fd-1c63-46f6-9993-ebaa06ee5309 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:32.942864 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-66a098fd-1c63-46f6-9993-ebaa06ee5309 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:32.943652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-66a098fd-1c63-46f6-9993-ebaa06ee5309 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:32.944084 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-66a098fd-1c63-46f6-9993-ebaa06ee5309 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:32.975381 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-66a098fd-1c63-46f6-9993-ebaa06ee5309 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lazy-loading 'flavor' on Instance uuid 02f5ae39-c48a-49e8-81b0-5f1ea289f14f {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:45:32.986713 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-17262454-7854-4ab1-b3fe-6731667c731c tempest-VolumesTestJSON-1105086051 tempest-VolumesTestJSON-1105086051-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.148262 Jun 16 19:45:32.987543 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 138/270] 10.222.0.36 () {58 vars in 1154 bytes} [Thu Jun 16 19:45:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:33.526703 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-66a098fd-1c63-46f6-9993-ebaa06ee5309 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "POST /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f/action" status: 200 len: 32 microversion: 2.1 time: 0.608964 Jun 16 19:45:33.527620 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 133/271] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Jun 16 19:45:32 2022] POST /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f/action => generated 32 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:45:33.538136 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b7690f36-8095-4cc8-946f-d817379ec880 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:33.539099 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b7690f36-8095-4cc8-946f-d817379ec880 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:33.550008 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7690f36-8095-4cc8-946f-d817379ec880 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:33.550697 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7690f36-8095-4cc8-946f-d817379ec880 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:33.552012 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7690f36-8095-4cc8-946f-d817379ec880 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:33.552579 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7690f36-8095-4cc8-946f-d817379ec880 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:33.704442 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b7690f36-8095-4cc8-946f-d817379ec880 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:33.712087 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b7690f36-8095-4cc8-946f-d817379ec880 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.178676 Jun 16 19:45:33.712646 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 139/272] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:33 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:34.729626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c24e7efc-6546-4f2a-acb0-802c62219f54 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:34.733596 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c24e7efc-6546-4f2a-acb0-802c62219f54 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:34.745672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c24e7efc-6546-4f2a-acb0-802c62219f54 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:34.746173 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c24e7efc-6546-4f2a-acb0-802c62219f54 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:34.746993 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c24e7efc-6546-4f2a-acb0-802c62219f54 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:34.747431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c24e7efc-6546-4f2a-acb0-802c62219f54 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:35.102741 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c24e7efc-6546-4f2a-acb0-802c62219f54 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:35.113776 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c24e7efc-6546-4f2a-acb0-802c62219f54 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.388606 Jun 16 19:45:35.114524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 134/273] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:34 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:36.130746 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3d47bf43-9144-4f43-bb7c-aed17ccec976 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:36.131780 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3d47bf43-9144-4f43-bb7c-aed17ccec976 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:36.137960 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d47bf43-9144-4f43-bb7c-aed17ccec976 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:36.138831 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d47bf43-9144-4f43-bb7c-aed17ccec976 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:36.149905 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d47bf43-9144-4f43-bb7c-aed17ccec976 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:36.149905 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d47bf43-9144-4f43-bb7c-aed17ccec976 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:36.285054 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3d47bf43-9144-4f43-bb7c-aed17ccec976 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:36.292493 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3d47bf43-9144-4f43-bb7c-aed17ccec976 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.166013 Jun 16 19:45:36.293052 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 140/274] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:36 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:37.309791 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-64efa589-622c-4c70-b16a-2d4b4a78ec86 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:37.310875 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-64efa589-622c-4c70-b16a-2d4b4a78ec86 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:37.313342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=44 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:45:37.318435 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-64efa589-622c-4c70-b16a-2d4b4a78ec86 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:37.319008 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-64efa589-622c-4c70-b16a-2d4b4a78ec86 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:37.320051 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-64efa589-622c-4c70-b16a-2d4b4a78ec86 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:37.320584 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-64efa589-622c-4c70-b16a-2d4b4a78ec86 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:37.339054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:45:37.475036 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-64efa589-622c-4c70-b16a-2d4b4a78ec86 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:37.484025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-64efa589-622c-4c70-b16a-2d4b4a78ec86 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.178199 Jun 16 19:45:37.485040 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 135/275] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:37 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:37.996406 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2375c0fa-44fe-4b8c-8f96-f9832f9bcfaf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:37.996993 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2375c0fa-44fe-4b8c-8f96-f9832f9bcfaf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:38.003245 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2375c0fa-44fe-4b8c-8f96-f9832f9bcfaf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:38.003696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2375c0fa-44fe-4b8c-8f96-f9832f9bcfaf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:38.004498 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2375c0fa-44fe-4b8c-8f96-f9832f9bcfaf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:38.004931 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2375c0fa-44fe-4b8c-8f96-f9832f9bcfaf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:38.028857 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2375c0fa-44fe-4b8c-8f96-f9832f9bcfaf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/ips" status: 200 len: 149 microversion: 2.1 time: 0.036919 Jun 16 19:45:38.029963 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 141/276] 10.222.0.36 () {58 vars in 1247 bytes} [Thu Jun 16 19:45:37 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:45:38.504273 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e27e403f-acef-45b5-9aa3-e3e32bc09776 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:38.505286 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e27e403f-acef-45b5-9aa3-e3e32bc09776 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:38.513330 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e27e403f-acef-45b5-9aa3-e3e32bc09776 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:38.514619 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e27e403f-acef-45b5-9aa3-e3e32bc09776 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:38.515500 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e27e403f-acef-45b5-9aa3-e3e32bc09776 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:38.516188 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e27e403f-acef-45b5-9aa3-e3e32bc09776 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:38.761397 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e27e403f-acef-45b5-9aa3-e3e32bc09776 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:38.771862 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e27e403f-acef-45b5-9aa3-e3e32bc09776 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.271647 Jun 16 19:45:38.773185 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 136/277] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:38 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:39.788916 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1cf3dbfc-01ab-4b3b-864d-c0e8d291969d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:39.789616 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1cf3dbfc-01ab-4b3b-864d-c0e8d291969d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:39.795740 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1cf3dbfc-01ab-4b3b-864d-c0e8d291969d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:39.796259 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1cf3dbfc-01ab-4b3b-864d-c0e8d291969d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:39.797092 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1cf3dbfc-01ab-4b3b-864d-c0e8d291969d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:39.797618 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1cf3dbfc-01ab-4b3b-864d-c0e8d291969d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:39.921726 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1cf3dbfc-01ab-4b3b-864d-c0e8d291969d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:39.931658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1cf3dbfc-01ab-4b3b-864d-c0e8d291969d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.146527 Jun 16 19:45:39.932460 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 142/278] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:39 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:40.223909 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-483a688d-8e4c-4c6e-b950-ea41c1c3bc9a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1def8c3b-37e2-495d-ae2f-0caec5f46b31"}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:45:40.224991 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-483a688d-8e4c-4c6e-b950-ea41c1c3bc9a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:40.231956 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-483a688d-8e4c-4c6e-b950-ea41c1c3bc9a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:40.233018 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-483a688d-8e4c-4c6e-b950-ea41c1c3bc9a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:40.233800 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-483a688d-8e4c-4c6e-b950-ea41c1c3bc9a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:40.234239 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-483a688d-8e4c-4c6e-b950-ea41c1c3bc9a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:40.948685 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bf730a79-e97e-436b-95ec-4c3a46309da8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:40.950015 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-bf730a79-e97e-436b-95ec-4c3a46309da8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:40.955773 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bf730a79-e97e-436b-95ec-4c3a46309da8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:40.956365 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bf730a79-e97e-436b-95ec-4c3a46309da8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:40.957168 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bf730a79-e97e-436b-95ec-4c3a46309da8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:40.957607 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bf730a79-e97e-436b-95ec-4c3a46309da8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:41.166570 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-bf730a79-e97e-436b-95ec-4c3a46309da8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:41.177325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:45:41.186126 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-bf730a79-e97e-436b-95ec-4c3a46309da8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.241365 Jun 16 19:45:41.200796 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 143/279] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:40 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:41.285349 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b544316a-d8f7-423d-a170-64f94be81749 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-499948973", "imageRef": "9fcb2be6-02db-4853-a8d6-6478a75f26a3", "flavorRef": "452", "networks": [{"uuid": "ca802f06-7183-4201-a7b3-b1df08f868d7"}]}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:45:41.349813 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-b544316a-d8f7-423d-a170-64f94be81749 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] validate_networks() for [('ca802f06-7183-4201-a7b3-b1df08f868d7', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:45:41.414505 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-483a688d-8e4c-4c6e-b950-ea41c1c3bc9a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "POST /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.194240 Jun 16 19:45:41.415471 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 137/280] 10.222.0.36 () {60 vars in 1322 bytes} [Thu Jun 16 19:45:40 2022] POST /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 194 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:45:41.808596 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-b544316a-d8f7-423d-a170-64f94be81749 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:45:41.809011 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-b544316a-d8f7-423d-a170-64f94be81749 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:45:41.809636 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-b544316a-d8f7-423d-a170-64f94be81749 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:45:41.810493 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-b544316a-d8f7-423d-a170-64f94be81749 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:45:41.811106 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-b544316a-d8f7-423d-a170-64f94be81749 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:45:41.823774 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b544316a-d8f7-423d-a170-64f94be81749 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:41.823986 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b544316a-d8f7-423d-a170-64f94be81749 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:41.824788 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b544316a-d8f7-423d-a170-64f94be81749 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:41.825412 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b544316a-d8f7-423d-a170-64f94be81749 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:41.842733 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-b544316a-d8f7-423d-a170-64f94be81749 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Getting quotas for project da06c03197114259aac4bf5444485d51. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:45:41.846909 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-b544316a-d8f7-423d-a170-64f94be81749 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Getting quotas for user a7fd310fe0254401b10f6b1517994233 and project da06c03197114259aac4bf5444485d51. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:45:41.857937 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b544316a-d8f7-423d-a170-64f94be81749 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:45:41.860325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b544316a-d8f7-423d-a170-64f94be81749 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcb2be6-02db-4853-a8d6-6478a75f26a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:45:42.110259 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b544316a-d8f7-423d-a170-64f94be81749 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.828598 Jun 16 19:45:42.122200 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-238f2ce9-438c-4579-9d79-ed8a91a8dc57 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:42.123678 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-238f2ce9-438c-4579-9d79-ed8a91a8dc57 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:42.125779 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 144/281] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:45:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:45:42.219187 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-238f2ce9-438c-4579-9d79-ed8a91a8dc57 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:42.223385 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b2fc34b9-f34a-4ed3-a93a-d227eae78f40 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:42.224243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b2fc34b9-f34a-4ed3-a93a-d227eae78f40 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:42.240986 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-238f2ce9-438c-4579-9d79-ed8a91a8dc57 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1218 microversion: 2.1 time: 0.123754 Jun 16 19:45:42.254488 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b2fc34b9-f34a-4ed3-a93a-d227eae78f40 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:42.254968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b2fc34b9-f34a-4ed3-a93a-d227eae78f40 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:42.255300 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 138/282] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:42 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:45:42.259823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b2fc34b9-f34a-4ed3-a93a-d227eae78f40 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:42.259823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b2fc34b9-f34a-4ed3-a93a-d227eae78f40 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:42.418520 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b2fc34b9-f34a-4ed3-a93a-d227eae78f40 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:42.426512 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b2fc34b9-f34a-4ed3-a93a-d227eae78f40 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.214532 Jun 16 19:45:42.427113 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 145/283] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:42 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:43.259405 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e421ce4b-6098-4bbe-9e0f-7690eb5f56b8 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:43.260014 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e421ce4b-6098-4bbe-9e0f-7690eb5f56b8 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:43.313039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e421ce4b-6098-4bbe-9e0f-7690eb5f56b8 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:43.320108 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e421ce4b-6098-4bbe-9e0f-7690eb5f56b8 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1218 microversion: 2.1 time: 0.064238 Jun 16 19:45:43.320664 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 139/284] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:43 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:43.444022 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7c910c3f-b1f3-47e1-928e-506444dacb9b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:43.445023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7c910c3f-b1f3-47e1-928e-506444dacb9b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:43.447240 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:45:43.452139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7c910c3f-b1f3-47e1-928e-506444dacb9b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:43.452579 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7c910c3f-b1f3-47e1-928e-506444dacb9b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:43.453376 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7c910c3f-b1f3-47e1-928e-506444dacb9b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:43.453805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7c910c3f-b1f3-47e1-928e-506444dacb9b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:43.586082 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7c910c3f-b1f3-47e1-928e-506444dacb9b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:43.594725 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7c910c3f-b1f3-47e1-928e-506444dacb9b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.153956 Jun 16 19:45:43.603701 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 146/285] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:43 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:44.336892 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f9fdfe60-45f2-4274-819b-eca8cd3cce6d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:44.337513 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f9fdfe60-45f2-4274-819b-eca8cd3cce6d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:44.344895 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f9fdfe60-45f2-4274-819b-eca8cd3cce6d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:44.345344 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f9fdfe60-45f2-4274-819b-eca8cd3cce6d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:44.346106 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f9fdfe60-45f2-4274-819b-eca8cd3cce6d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:44.346601 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f9fdfe60-45f2-4274-819b-eca8cd3cce6d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:44.409861 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f9fdfe60-45f2-4274-819b-eca8cd3cce6d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:44.418590 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f9fdfe60-45f2-4274-819b-eca8cd3cce6d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1214 microversion: 2.1 time: 0.085653 Jun 16 19:45:44.421100 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 140/286] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:44 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:44.611329 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bc4f267a-e423-4c7b-a169-31a5880d0765 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:44.612316 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-bc4f267a-e423-4c7b-a169-31a5880d0765 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:44.618611 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bc4f267a-e423-4c7b-a169-31a5880d0765 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:44.619144 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bc4f267a-e423-4c7b-a169-31a5880d0765 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:44.620009 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bc4f267a-e423-4c7b-a169-31a5880d0765 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:44.620448 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bc4f267a-e423-4c7b-a169-31a5880d0765 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:44.749385 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-bc4f267a-e423-4c7b-a169-31a5880d0765 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:44.757132 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-bc4f267a-e423-4c7b-a169-31a5880d0765 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.150509 Jun 16 19:45:44.757620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 147/287] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:44 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:45.254594 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f6fd8dfe-42ee-4292-aaef-af317f11cad5 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-750342016", "imageRef": "9fcb2be6-02db-4853-a8d6-6478a75f26a3", "flavorRef": "452", "networks": [{"uuid": "9211c9f6-79c8-45ba-a53f-4f8f2e900b07"}]}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:45:45.309574 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.network.neutron [None req-f6fd8dfe-42ee-4292-aaef-af317f11cad5 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] validate_networks() for [('9211c9f6-79c8-45ba-a53f-4f8f2e900b07', None, None, None, None, None)] {{(pid=124551) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:45:45.439395 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-733006ed-c0cf-459c-9dad-1ff18a58d747 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:45.449542 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-733006ed-c0cf-459c-9dad-1ff18a58d747 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:45.456012 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-733006ed-c0cf-459c-9dad-1ff18a58d747 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:45.456578 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-733006ed-c0cf-459c-9dad-1ff18a58d747 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:45.457510 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-733006ed-c0cf-459c-9dad-1ff18a58d747 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:45.458008 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-733006ed-c0cf-459c-9dad-1ff18a58d747 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:45.545807 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-733006ed-c0cf-459c-9dad-1ff18a58d747 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:45.554774 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-733006ed-c0cf-459c-9dad-1ff18a58d747 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1278 microversion: 2.1 time: 0.120320 Jun 16 19:45:45.555505 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 148/288] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:45 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1278 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:45.773274 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0aceda2a-b925-40af-8664-9c109aacd5cc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:45.774053 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0aceda2a-b925-40af-8664-9c109aacd5cc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:45.780523 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0aceda2a-b925-40af-8664-9c109aacd5cc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:45.781218 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0aceda2a-b925-40af-8664-9c109aacd5cc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:45.781860 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0aceda2a-b925-40af-8664-9c109aacd5cc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:45.782285 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0aceda2a-b925-40af-8664-9c109aacd5cc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:46.117518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-f6fd8dfe-42ee-4292-aaef-af317f11cad5 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Flavor limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:45:46.118014 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-f6fd8dfe-42ee-4292-aaef-af317f11cad5 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Image limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:45:46.118405 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-f6fd8dfe-42ee-4292-aaef-af317f11cad5 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Flavor pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:45:46.118813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-f6fd8dfe-42ee-4292-aaef-af317f11cad5 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Image pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:45:46.119404 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-f6fd8dfe-42ee-4292-aaef-af317f11cad5 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:45:46.119504 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0aceda2a-b925-40af-8664-9c109aacd5cc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:46.127686 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0aceda2a-b925-40af-8664-9c109aacd5cc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.358428 Jun 16 19:45:46.128242 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 149/289] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:45 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:45:46.133769 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f6fd8dfe-42ee-4292-aaef-af317f11cad5 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:46.134620 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f6fd8dfe-42ee-4292-aaef-af317f11cad5 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:46.136057 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f6fd8dfe-42ee-4292-aaef-af317f11cad5 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:46.136614 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f6fd8dfe-42ee-4292-aaef-af317f11cad5 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:46.154534 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-f6fd8dfe-42ee-4292-aaef-af317f11cad5 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Getting quotas for project 7ca93a40aa85448a8e5165f4c268678a. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:45:46.158620 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-f6fd8dfe-42ee-4292-aaef-af317f11cad5 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Getting quotas for user 61d74fdb719b40208ee408b838256a0f and project 7ca93a40aa85448a8e5165f4c268678a. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:45:46.177503 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f6fd8dfe-42ee-4292-aaef-af317f11cad5 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Going to run 1 instances... {{(pid=124551) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:45:46.187056 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f6fd8dfe-42ee-4292-aaef-af317f11cad5 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcb2be6-02db-4853-a8d6-6478a75f26a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:45:46.373499 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f6fd8dfe-42ee-4292-aaef-af317f11cad5 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.122757 Jun 16 19:45:46.374207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 141/290] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:45:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 19:45:46.386365 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-469fbd7e-0399-464e-abce-3dd4472b0017 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:46.387913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-469fbd7e-0399-464e-abce-3dd4472b0017 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:46.446772 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-469fbd7e-0399-464e-abce-3dd4472b0017 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:46.456703 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-469fbd7e-0399-464e-abce-3dd4472b0017 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1213 microversion: 2.1 time: 0.076316 Jun 16 19:45:46.457268 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 150/291] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:46 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:46.580632 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-928c5479-32d7-47d9-961d-04dbdbf920ef tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:46.580632 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-928c5479-32d7-47d9-961d-04dbdbf920ef tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:46.587376 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-928c5479-32d7-47d9-961d-04dbdbf920ef tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:46.588454 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-928c5479-32d7-47d9-961d-04dbdbf920ef tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:46.590643 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-928c5479-32d7-47d9-961d-04dbdbf920ef tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:46.591344 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-928c5479-32d7-47d9-961d-04dbdbf920ef tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:46.685930 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-928c5479-32d7-47d9-961d-04dbdbf920ef tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:46.693720 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-928c5479-32d7-47d9-961d-04dbdbf920ef tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1276 microversion: 2.1 time: 0.121042 Jun 16 19:45:46.694280 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 142/292] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:46 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1276 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:47.144318 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-478d4a77-d7f0-4f7c-ab30-d10db9af9b4b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:47.144934 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-478d4a77-d7f0-4f7c-ab30-d10db9af9b4b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:47.151232 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-478d4a77-d7f0-4f7c-ab30-d10db9af9b4b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:47.151683 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-478d4a77-d7f0-4f7c-ab30-d10db9af9b4b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:47.152790 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-478d4a77-d7f0-4f7c-ab30-d10db9af9b4b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:47.153254 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-478d4a77-d7f0-4f7c-ab30-d10db9af9b4b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:47.337064 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-478d4a77-d7f0-4f7c-ab30-d10db9af9b4b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:47.350675 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-478d4a77-d7f0-4f7c-ab30-d10db9af9b4b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.210262 Jun 16 19:45:47.351710 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 151/293] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:47 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:47.473721 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8a47aa61-bca4-4085-9f4e-b2ba2c8e8289 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:47.474585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8a47aa61-bca4-4085-9f4e-b2ba2c8e8289 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:47.532160 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8a47aa61-bca4-4085-9f4e-b2ba2c8e8289 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:47.538712 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8a47aa61-bca4-4085-9f4e-b2ba2c8e8289 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1213 microversion: 2.1 time: 0.068974 Jun 16 19:45:47.539311 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 143/294] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:47 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:47.711690 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f5bf1452-b0a7-47fb-a65c-8c9f2ddcd413 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:47.712667 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f5bf1452-b0a7-47fb-a65c-8c9f2ddcd413 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:47.719336 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f5bf1452-b0a7-47fb-a65c-8c9f2ddcd413 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:47.719788 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f5bf1452-b0a7-47fb-a65c-8c9f2ddcd413 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:47.720756 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f5bf1452-b0a7-47fb-a65c-8c9f2ddcd413 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:47.721197 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f5bf1452-b0a7-47fb-a65c-8c9f2ddcd413 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:47.855016 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f5bf1452-b0a7-47fb-a65c-8c9f2ddcd413 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:47.863898 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f5bf1452-b0a7-47fb-a65c-8c9f2ddcd413 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1318 microversion: 2.1 time: 0.155940 Jun 16 19:45:47.865152 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 152/295] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:47 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:47.898406 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-0f918f1d-ba59-4eb2-831a-a72985851ea2 req-da7df904-ab27-403c-a049-1ed9ad840345 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa082a59-b1ab-4fee-a88f-4823691ff8e1", "tag": "545ea0e3-eba0-43e9-9951-d3d05efd1370"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:45:47.907203 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-0f918f1d-ba59-4eb2-831a-a72985851ea2 req-da7df904-ab27-403c-a049-1ed9ad840345 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:47.907650 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-0f918f1d-ba59-4eb2-831a-a72985851ea2 req-da7df904-ab27-403c-a049-1ed9ad840345 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:47.917881 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-0f918f1d-ba59-4eb2-831a-a72985851ea2 req-da7df904-ab27-403c-a049-1ed9ad840345 service nova] Creating event network-changed:545ea0e3-eba0-43e9-9951-d3d05efd1370 for instance fa082a59-b1ab-4fee-a88f-4823691ff8e1 on hv-cinder-84617 Jun 16 19:45:47.922987 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-0f918f1d-ba59-4eb2-831a-a72985851ea2 req-da7df904-ab27-403c-a049-1ed9ad840345 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028321 Jun 16 19:45:47.923947 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 144/296] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:45:48.448774 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-63a3a38e-2af2-4781-ad5b-da2fddd06334 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:48.448774 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-63a3a38e-2af2-4781-ad5b-da2fddd06334 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:48.448774 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-63a3a38e-2af2-4781-ad5b-da2fddd06334 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:48.448774 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-63a3a38e-2af2-4781-ad5b-da2fddd06334 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:48.449934 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-63a3a38e-2af2-4781-ad5b-da2fddd06334 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:48.449934 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-63a3a38e-2af2-4781-ad5b-da2fddd06334 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:48.512416 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-63a3a38e-2af2-4781-ad5b-da2fddd06334 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:48.520216 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-63a3a38e-2af2-4781-ad5b-da2fddd06334 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.157524 Jun 16 19:45:48.521326 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 153/297] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:48 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:48.557826 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b644b365-4b59-4441-af8c-ffac11cb8f90 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:48.557826 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b644b365-4b59-4441-af8c-ffac11cb8f90 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:48.564027 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b644b365-4b59-4441-af8c-ffac11cb8f90 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:48.564468 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b644b365-4b59-4441-af8c-ffac11cb8f90 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:48.565219 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b644b365-4b59-4441-af8c-ffac11cb8f90 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:48.565651 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b644b365-4b59-4441-af8c-ffac11cb8f90 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:48.629150 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b644b365-4b59-4441-af8c-ffac11cb8f90 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:48.635548 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b644b365-4b59-4441-af8c-ffac11cb8f90 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1217 microversion: 2.1 time: 0.083169 Jun 16 19:45:48.636098 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 145/298] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:48 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:48.881289 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7297ba8d-c3bd-4595-b906-019a7f04d736 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:48.882185 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7297ba8d-c3bd-4595-b906-019a7f04d736 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:48.889483 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7297ba8d-c3bd-4595-b906-019a7f04d736 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:48.894093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7297ba8d-c3bd-4595-b906-019a7f04d736 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:48.897391 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7297ba8d-c3bd-4595-b906-019a7f04d736 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:48.898347 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7297ba8d-c3bd-4595-b906-019a7f04d736 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:49.061791 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7297ba8d-c3bd-4595-b906-019a7f04d736 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:49.070033 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7297ba8d-c3bd-4595-b906-019a7f04d736 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1318 microversion: 2.1 time: 0.193180 Jun 16 19:45:49.071179 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 154/299] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:48 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:49.537153 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-542475e6-af97-4860-9459-debb05e6248e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:49.537769 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-542475e6-af97-4860-9459-debb05e6248e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:49.543868 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-542475e6-af97-4860-9459-debb05e6248e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:49.544385 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-542475e6-af97-4860-9459-debb05e6248e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:49.545663 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-542475e6-af97-4860-9459-debb05e6248e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:49.546317 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-542475e6-af97-4860-9459-debb05e6248e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:49.651952 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cccff671-b77f-4167-a040-5daac4728572 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:49.653154 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-cccff671-b77f-4167-a040-5daac4728572 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:49.663232 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cccff671-b77f-4167-a040-5daac4728572 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:49.663743 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cccff671-b77f-4167-a040-5daac4728572 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:49.676173 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cccff671-b77f-4167-a040-5daac4728572 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:49.676173 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cccff671-b77f-4167-a040-5daac4728572 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:49.778104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-542475e6-af97-4860-9459-debb05e6248e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:49.786660 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-542475e6-af97-4860-9459-debb05e6248e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.253258 Jun 16 19:45:49.787455 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 146/300] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:49 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:49.789540 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cccff671-b77f-4167-a040-5daac4728572 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:49.803303 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cccff671-b77f-4167-a040-5daac4728572 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1265 microversion: 2.1 time: 0.155128 Jun 16 19:45:49.814233 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 155/301] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:49 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:49.979156 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-4a9e3e7d-9ef4-4155-8f7d-ba2b9bfc3410 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:49.979656 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-4a9e3e7d-9ef4-4155-8f7d-ba2b9bfc3410 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:49.985766 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4a9e3e7d-9ef4-4155-8f7d-ba2b9bfc3410 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:49.986213 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4a9e3e7d-9ef4-4155-8f7d-ba2b9bfc3410 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:49.986997 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4a9e3e7d-9ef4-4155-8f7d-ba2b9bfc3410 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:49.987438 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4a9e3e7d-9ef4-4155-8f7d-ba2b9bfc3410 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:50.010004 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-4a9e3e7d-9ef4-4155-8f7d-ba2b9bfc3410 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/ips" status: 200 len: 151 microversion: 2.20 time: 0.034762 Jun 16 19:45:50.010554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 147/302] 10.222.0.36 () {60 vars in 1288 bytes} [Thu Jun 16 19:45:49 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:45:50.087260 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5381a456-c58a-4a28-bde4-56ec9eb89733 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:50.087962 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5381a456-c58a-4a28-bde4-56ec9eb89733 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:50.094486 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5381a456-c58a-4a28-bde4-56ec9eb89733 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:50.094941 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5381a456-c58a-4a28-bde4-56ec9eb89733 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:50.095821 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5381a456-c58a-4a28-bde4-56ec9eb89733 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:50.096359 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5381a456-c58a-4a28-bde4-56ec9eb89733 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:50.252828 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5381a456-c58a-4a28-bde4-56ec9eb89733 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:50.260261 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5381a456-c58a-4a28-bde4-56ec9eb89733 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1318 microversion: 2.1 time: 0.177003 Jun 16 19:45:50.260827 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 156/303] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:50 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:50.803805 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0056dcb9-f56f-4abc-91b9-5ca2ec338082 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:50.804474 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0056dcb9-f56f-4abc-91b9-5ca2ec338082 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:50.810903 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0056dcb9-f56f-4abc-91b9-5ca2ec338082 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:50.811378 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0056dcb9-f56f-4abc-91b9-5ca2ec338082 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:50.812132 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0056dcb9-f56f-4abc-91b9-5ca2ec338082 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:50.812601 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0056dcb9-f56f-4abc-91b9-5ca2ec338082 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:50.821598 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b1a3546a-1694-4a03-917f-d761c8f64944 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:50.822202 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b1a3546a-1694-4a03-917f-d761c8f64944 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:50.828146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b1a3546a-1694-4a03-917f-d761c8f64944 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:50.828602 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b1a3546a-1694-4a03-917f-d761c8f64944 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:50.829357 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b1a3546a-1694-4a03-917f-d761c8f64944 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:50.829787 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b1a3546a-1694-4a03-917f-d761c8f64944 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:50.901317 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b1a3546a-1694-4a03-917f-d761c8f64944 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:50.901317 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b1a3546a-1694-4a03-917f-d761c8f64944 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1265 microversion: 2.1 time: 0.081767 Jun 16 19:45:50.901317 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 157/304] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:50 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:45:50.954985 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0056dcb9-f56f-4abc-91b9-5ca2ec338082 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:50.959760 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0056dcb9-f56f-4abc-91b9-5ca2ec338082 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.159764 Jun 16 19:45:50.960729 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 148/305] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:50 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:51.137520 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6e09fb22-8738-4460-bbb9-cfbc3bc33210 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Action: 'create', calling method: .version_select at 0x7f050291a8b0>, body: {"keypair": {"name": "tempest-keypair-403229789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk9oA8Z1URg5fKAeu4jSJiETtwahKMs0UjcNPfSUkKRAHEYIJyDgau6C5CdUh79saO05AFwn0PKhW8gCHqA7NxdCxngKU9ImpP9QfWp+vsY2tkyCdaQdF4OyKeP/J3Ueg=="}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:45:51.155504 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-6e09fb22-8738-4460-bbb9-cfbc3bc33210 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Getting quotas for project 47a4ab888dd74218ab5d7812ad095371. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:45:51.168356 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-6e09fb22-8738-4460-bbb9-cfbc3bc33210 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Getting quotas for user 4df05cbf303c4524a665b429f240a17a and project 47a4ab888dd74218ab5d7812ad095371. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:45:51.280774 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f8bea1d2-1394-45c4-82e8-9f54d66d6ac6 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:51.280774 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f8bea1d2-1394-45c4-82e8-9f54d66d6ac6 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:51.285500 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f8bea1d2-1394-45c4-82e8-9f54d66d6ac6 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:51.286224 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f8bea1d2-1394-45c4-82e8-9f54d66d6ac6 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:51.287086 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f8bea1d2-1394-45c4-82e8-9f54d66d6ac6 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:51.287583 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f8bea1d2-1394-45c4-82e8-9f54d66d6ac6 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:51.329640 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6e09fb22-8738-4460-bbb9-cfbc3bc33210 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.196736 Jun 16 19:45:51.330260 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 158/306] 10.222.0.36 () {60 vars in 1158 bytes} [Thu Jun 16 19:45:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:45:51.431594 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f8bea1d2-1394-45c4-82e8-9f54d66d6ac6 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:51.440949 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f8bea1d2-1394-45c4-82e8-9f54d66d6ac6 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1318 microversion: 2.1 time: 0.167109 Jun 16 19:45:51.441511 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 149/307] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:51 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:45:51.924953 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a7ff503c-1d74-4dab-8f90-87cf49d4bf92 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:51.927585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a7ff503c-1d74-4dab-8f90-87cf49d4bf92 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:51.933323 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:45:51.946995 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a7ff503c-1d74-4dab-8f90-87cf49d4bf92 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:51.953282 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a7ff503c-1d74-4dab-8f90-87cf49d4bf92 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:51.955253 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a7ff503c-1d74-4dab-8f90-87cf49d4bf92 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:51.955587 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a7ff503c-1d74-4dab-8f90-87cf49d4bf92 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:51.980027 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f5dacfd1-a695-496e-8851-186e72ddce50 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:51.982436 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f5dacfd1-a695-496e-8851-186e72ddce50 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:51.993545 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f5dacfd1-a695-496e-8851-186e72ddce50 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:51.995145 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f5dacfd1-a695-496e-8851-186e72ddce50 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:51.996037 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f5dacfd1-a695-496e-8851-186e72ddce50 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:51.998697 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f5dacfd1-a695-496e-8851-186e72ddce50 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:52.037813 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a7ff503c-1d74-4dab-8f90-87cf49d4bf92 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:52.046764 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a7ff503c-1d74-4dab-8f90-87cf49d4bf92 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1273 microversion: 2.1 time: 0.133220 Jun 16 19:45:52.055411 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 159/308] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:51 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1273 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:52.223082 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f5dacfd1-a695-496e-8851-186e72ddce50 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:52.230648 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f5dacfd1-a695-496e-8851-186e72ddce50 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.257442 Jun 16 19:45:52.231241 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 150/309] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:51 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:45:52.458361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f0ce7d08-8d56-43e4-8fc7-1542326439f7 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:52.459005 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f0ce7d08-8d56-43e4-8fc7-1542326439f7 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:52.465870 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f0ce7d08-8d56-43e4-8fc7-1542326439f7 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:52.466677 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f0ce7d08-8d56-43e4-8fc7-1542326439f7 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:52.467761 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f0ce7d08-8d56-43e4-8fc7-1542326439f7 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:52.468205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f0ce7d08-8d56-43e4-8fc7-1542326439f7 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:52.666740 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f0ce7d08-8d56-43e4-8fc7-1542326439f7 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:52.666740 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f0ce7d08-8d56-43e4-8fc7-1542326439f7 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1318 microversion: 2.1 time: 0.211850 Jun 16 19:45:52.668780 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 160/310] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:52 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:53.079705 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e21b75a9-3308-4375-aa92-fcc26758cd7f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:53.079705 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e21b75a9-3308-4375-aa92-fcc26758cd7f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:53.083358 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e21b75a9-3308-4375-aa92-fcc26758cd7f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:53.083947 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e21b75a9-3308-4375-aa92-fcc26758cd7f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:53.087211 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e21b75a9-3308-4375-aa92-fcc26758cd7f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:53.087549 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e21b75a9-3308-4375-aa92-fcc26758cd7f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:53.248427 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-461fbb95-1f12-4a96-890e-4f48335a7357 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:53.249321 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-461fbb95-1f12-4a96-890e-4f48335a7357 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:53.255668 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-461fbb95-1f12-4a96-890e-4f48335a7357 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:53.256465 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-461fbb95-1f12-4a96-890e-4f48335a7357 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:53.257671 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-461fbb95-1f12-4a96-890e-4f48335a7357 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:53.258775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-461fbb95-1f12-4a96-890e-4f48335a7357 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:53.310684 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e21b75a9-3308-4375-aa92-fcc26758cd7f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:53.329141 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e21b75a9-3308-4375-aa92-fcc26758cd7f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1313 microversion: 2.1 time: 0.258095 Jun 16 19:45:53.330261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 151/311] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:53 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:53.485189 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-461fbb95-1f12-4a96-890e-4f48335a7357 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:53.494834 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-461fbb95-1f12-4a96-890e-4f48335a7357 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.250306 Jun 16 19:45:53.495608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 161/312] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:53 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:53.686822 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c33bccc5-7290-4f6a-8eba-0f20857b9517 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:53.687512 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c33bccc5-7290-4f6a-8eba-0f20857b9517 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:53.698676 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c33bccc5-7290-4f6a-8eba-0f20857b9517 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:53.701293 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c33bccc5-7290-4f6a-8eba-0f20857b9517 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:53.701293 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c33bccc5-7290-4f6a-8eba-0f20857b9517 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:53.701753 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c33bccc5-7290-4f6a-8eba-0f20857b9517 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:54.105918 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9b44da6b-e359-484d-bc40-f962f93f16bd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:45:54.106457 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9b44da6b-e359-484d-bc40-f962f93f16bd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:54.117589 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9b44da6b-e359-484d-bc40-f962f93f16bd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:54.118035 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9b44da6b-e359-484d-bc40-f962f93f16bd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:54.119618 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9b44da6b-e359-484d-bc40-f962f93f16bd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:54.120220 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9b44da6b-e359-484d-bc40-f962f93f16bd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:54.150441 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-9b44da6b-e359-484d-bc40-f962f93f16bd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lazy-loading 'flavor' on Instance uuid f667dde1-232e-4f14-917f-0a749279d6a8 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:45:54.189160 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:45:54.245835 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c33bccc5-7290-4f6a-8eba-0f20857b9517 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:54.271391 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c33bccc5-7290-4f6a-8eba-0f20857b9517 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1318 microversion: 2.1 time: 0.589108 Jun 16 19:45:54.272595 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 152/313] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:53 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1318 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:54.347251 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7b94aca5-35a6-402a-bfa8-f458789c7e03 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:54.348585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-7b94aca5-35a6-402a-bfa8-f458789c7e03 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:54.358326 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7b94aca5-35a6-402a-bfa8-f458789c7e03 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:54.359748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7b94aca5-35a6-402a-bfa8-f458789c7e03 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:54.361043 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7b94aca5-35a6-402a-bfa8-f458789c7e03 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:54.369596 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7b94aca5-35a6-402a-bfa8-f458789c7e03 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:54.602092 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-7b94aca5-35a6-402a-bfa8-f458789c7e03 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:54.619100 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-7b94aca5-35a6-402a-bfa8-f458789c7e03 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1313 microversion: 2.1 time: 0.268968 Jun 16 19:45:54.619845 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 153/314] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:54 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:54.625030 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-18f28e9e-f403-4189-8638-30b14993015c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:54.625850 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-18f28e9e-f403-4189-8638-30b14993015c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:54.632060 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-18f28e9e-f403-4189-8638-30b14993015c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:54.632504 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-18f28e9e-f403-4189-8638-30b14993015c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:54.633258 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-18f28e9e-f403-4189-8638-30b14993015c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:54.633689 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-18f28e9e-f403-4189-8638-30b14993015c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:54.788539 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-18f28e9e-f403-4189-8638-30b14993015c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:54.797261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-18f28e9e-f403-4189-8638-30b14993015c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1501 microversion: 2.1 time: 0.176136 Jun 16 19:45:54.797858 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 154/315] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:54 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1501 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:54.813922 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-56ae8625-138b-4a36-8c55-3de4809b2d5d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5db2b1d3-20e3-485f-88cc-a3a817bfd2eb"}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:45:54.820632 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-56ae8625-138b-4a36-8c55-3de4809b2d5d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:54.821373 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-56ae8625-138b-4a36-8c55-3de4809b2d5d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:54.821826 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-56ae8625-138b-4a36-8c55-3de4809b2d5d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:54.822716 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-56ae8625-138b-4a36-8c55-3de4809b2d5d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:54.823288 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-56ae8625-138b-4a36-8c55-3de4809b2d5d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:54.840620 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:45:54.847776 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-56ae8625-138b-4a36-8c55-3de4809b2d5d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] HTTP exception thrown: Cannot 'attach_volume' instance 02f5ae39-c48a-49e8-81b0-5f1ea289f14f while it is in vm_state rescued Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-56ae8625-138b-4a36-8c55-3de4809b2d5d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Request method failure captured: Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: POST /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f/os-volume_attachments HTTP/1.1 Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 74 Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4f2bJrSUVHDMMTqU2Jad-fuYa-ofXk1y9tRV-Se49xlEwwcbihzp3u5EHqEbpzFBj_5sSZbxubYd39VX764172H-VM9cSazwalfJq36RSCcub4-RnQ89lgkzUX_84lIDug8hDGmNJ1OxRyHEdc235OBU20Fo3EaYIsAMLvUvs-yb6k Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 7153c09b2d0b4805ad0360afb7ecd3ca Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-842795293 Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:45:54.849429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:45:54.850980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7153c09b2d0b4805ad0360afb7ecd3ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7153c09b2d0b4805ad0360afb7ecd3ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7153c09b2d0b4805ad0360afb7ecd3ca", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7153c09b2d0b4805ad0360afb7ecd3ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:45:54.850980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-ServerRescueNegativeTestJSON-842795293 Jun 16 19:45:54.850980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 7153c09b2d0b4805ad0360afb7ecd3ca Jun 16 19:45:54.850980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-842795293 Jun 16 19:45:54.850980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-ServerRescueNegativeTestJSON-842795293-project Jun 16 19:45:54.850980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:45:54.850980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:45:54.850980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 2d0d5723417d4b60bc51e47f28d09902 Jun 16 19:45:54.850980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-ServerRescueNegativeTestJSON-842795293-project Jun 16 19:45:54.850980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Jun 16 19:45:54.850980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {"volumeAttachment": {"volumeId": "5db2b1d3-20e3-485f-88cc-a3a817bfd2eb"}} Jun 16 19:45:54.850980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:45:54.851818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Cannot 'attach_volume' instance 02f5ae39-c48a-49e8-81b0-5f1ea289f14f while it is in vm_state rescued Jun 16 19:45:54.851818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'server_id': '02f5ae39-c48a-49e8-81b0-5f1ea289f14f', 'body': {'volumeAttachment': {'volumeId': '5db2b1d3-20e3-485f-88cc-a3a817bfd2eb'}}} Jun 16 19:45:54.851818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:45:54.851818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:45:54.851818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 19:45:54.851818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 19:45:54.851818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 19:45:54.851818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:45:54.851818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 19:45:54.851818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 19:45:54.851818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 02f5ae39-c48a-49e8-81b0-5f1ea289f14f in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 19:45:54.851818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:54.851818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:45:54.851818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:54.851818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:45:54.851818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:45:54.851818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:45:54.851818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:45:54.851818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:45:54.853039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:45:54.853039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:45:54.853039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:45:54.853039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:45:54.853039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:45:54.853039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:45:54.853039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:45:54.853039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:45:54.853039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 19:45:54.853039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 19:45:54.853039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 19:45:54.853039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 19:45:54.853039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 02f5ae39-c48a-49e8-81b0-5f1ea289f14f while it is in vm_state rescued Jun 16 19:45:54.853039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:54.853039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:45:54.853039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:54.853039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:45:54.853039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:45:54.853039 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:45:54.854269 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:45:54.854269 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:45:54.854269 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 02f5ae39-c48a-49e8-81b0-5f1ea289f14f while it is in vm_state rescued Jun 16 19:45:54.854269 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:45:54.854269 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-56ae8625-138b-4a36-8c55-3de4809b2d5d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Returning 409 to user: Cannot 'attach_volume' instance 02f5ae39-c48a-49e8-81b0-5f1ea289f14f while it is in vm_state rescued {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:45:54.854269 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-56ae8625-138b-4a36-8c55-3de4809b2d5d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "POST /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040904 Jun 16 19:45:54.854269 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 155/316] 10.222.0.36 () {60 vars in 1322 bytes} [Thu Jun 16 19:45:54 2022] POST /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 16 19:45:54.860226 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-de7eea50-9fca-4a33-98d4-9fc4b512cbed tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:45:54.860769 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-de7eea50-9fca-4a33-98d4-9fc4b512cbed tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:54.866955 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-de7eea50-9fca-4a33-98d4-9fc4b512cbed tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:54.867523 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-de7eea50-9fca-4a33-98d4-9fc4b512cbed tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:54.868241 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-de7eea50-9fca-4a33-98d4-9fc4b512cbed tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:54.868679 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-de7eea50-9fca-4a33-98d4-9fc4b512cbed tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:55.048787 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9b44da6b-e359-484d-bc40-f962f93f16bd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "POST /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/action" status: 202 len: 0 microversion: 2.20 time: 0.949987 Jun 16 19:45:55.050267 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 162/317] 10.222.0.36 () {62 vars in 1318 bytes} [Thu Jun 16 19:45:54 2022] POST /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/action => generated 0 bytes in 953 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:45:55.055968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-c87d163e-4efe-4074-9c38-f5ef8d8b2538 req-d2933601-018b-4157-a1b7-5da09c8a8f67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d8add5e-2cff-4707-b035-9db6bfdf812c", "tag": "7fcade0a-4088-4731-8a34-571360d83e6d"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:45:55.079323 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-c87d163e-4efe-4074-9c38-f5ef8d8b2538 req-d2933601-018b-4157-a1b7-5da09c8a8f67 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:55.080227 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-c87d163e-4efe-4074-9c38-f5ef8d8b2538 req-d2933601-018b-4157-a1b7-5da09c8a8f67 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:55.099666 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-c87d163e-4efe-4074-9c38-f5ef8d8b2538 req-d2933601-018b-4157-a1b7-5da09c8a8f67 service nova] Creating event network-changed:7fcade0a-4088-4731-8a34-571360d83e6d for instance 5d8add5e-2cff-4707-b035-9db6bfdf812c on hv-cinder-84617 Jun 16 19:45:55.105534 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-c87d163e-4efe-4074-9c38-f5ef8d8b2538 req-d2933601-018b-4157-a1b7-5da09c8a8f67 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053643 Jun 16 19:45:55.106442 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 163/318] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:45:55.119182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-efadd758-a547-4fc1-b5f5-93859d74d7d1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1230125978", "imageRef": "9fcb2be6-02db-4853-a8d6-6478a75f26a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "521c8502-275d-4cd0-b45c-aec01d2fbcf4"}], "security_groups": [{"name": "tempest-securitygroup--2103218096"}], "key_name": "tempest-keypair-403229789", "user_data": "}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:45:55.173841 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-de7eea50-9fca-4a33-98d4-9fc4b512cbed tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "POST /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f/action" status: 202 len: 0 microversion: 2.1 time: 0.316985 Jun 16 19:45:55.178563 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 156/319] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Jun 16 19:45:54 2022] POST /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:45:55.207625 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c6312a1e-d0ea-47ce-8e43-b9763892b125 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:55.208619 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c6312a1e-d0ea-47ce-8e43-b9763892b125 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:55.225816 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c6312a1e-d0ea-47ce-8e43-b9763892b125 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:55.228527 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c6312a1e-d0ea-47ce-8e43-b9763892b125 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:55.229340 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c6312a1e-d0ea-47ce-8e43-b9763892b125 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:55.229786 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c6312a1e-d0ea-47ce-8e43-b9763892b125 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:55.278959 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-efadd758-a547-4fc1-b5f5-93859d74d7d1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] validate_networks() for [('521c8502-275d-4cd0-b45c-aec01d2fbcf4', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:45:55.518544 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c6312a1e-d0ea-47ce-8e43-b9763892b125 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:55.530334 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c6312a1e-d0ea-47ce-8e43-b9763892b125 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:55.530334 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c6312a1e-d0ea-47ce-8e43-b9763892b125 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:55.530334 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c6312a1e-d0ea-47ce-8e43-b9763892b125 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.334098 Jun 16 19:45:55.535194 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 157/320] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:45:55 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:45:55.542667 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-17bb69e8-b21e-4883-a712-91d1372bcd97 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:55.543660 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-17bb69e8-b21e-4883-a712-91d1372bcd97 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:55.551912 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-17bb69e8-b21e-4883-a712-91d1372bcd97 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:55.552375 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-17bb69e8-b21e-4883-a712-91d1372bcd97 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:55.553150 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-17bb69e8-b21e-4883-a712-91d1372bcd97 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:55.553757 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-17bb69e8-b21e-4883-a712-91d1372bcd97 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:55.807518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-17bb69e8-b21e-4883-a712-91d1372bcd97 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:55.816631 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-17bb69e8-b21e-4883-a712-91d1372bcd97 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1509 microversion: 2.1 time: 0.279591 Jun 16 19:45:55.817201 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 158/321] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:55 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1509 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:55.822307 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-76403474-6857-4255-aab8-3ba7a1655a85 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:55.823164 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-76403474-6857-4255-aab8-3ba7a1655a85 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:55.831358 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-76403474-6857-4255-aab8-3ba7a1655a85 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:55.832048 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-76403474-6857-4255-aab8-3ba7a1655a85 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:55.832855 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-76403474-6857-4255-aab8-3ba7a1655a85 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:55.833288 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-76403474-6857-4255-aab8-3ba7a1655a85 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:55.983992 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-76403474-6857-4255-aab8-3ba7a1655a85 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:55.991476 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-76403474-6857-4255-aab8-3ba7a1655a85 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1318 microversion: 2.1 time: 0.173141 Jun 16 19:45:55.992042 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 159/322] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:55 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:55.996664 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-a69ecaeb-f5d3-48e7-a236-4ca120a4e000 req-ea435fac-d520-4df3-a7f5-9a1b8623c53c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa082a59-b1ab-4fee-a88f-4823691ff8e1", "name": "network-vif-plugged", "status": "completed", "tag": "545ea0e3-eba0-43e9-9951-d3d05efd1370"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:45:56.005630 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-a69ecaeb-f5d3-48e7-a236-4ca120a4e000 req-ea435fac-d520-4df3-a7f5-9a1b8623c53c service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:56.006268 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-a69ecaeb-f5d3-48e7-a236-4ca120a4e000 req-ea435fac-d520-4df3-a7f5-9a1b8623c53c service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:56.018612 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-a69ecaeb-f5d3-48e7-a236-4ca120a4e000 req-ea435fac-d520-4df3-a7f5-9a1b8623c53c service nova] Creating event network-vif-plugged:545ea0e3-eba0-43e9-9951-d3d05efd1370 for instance fa082a59-b1ab-4fee-a88f-4823691ff8e1 on hv-cinder-84617 Jun 16 19:45:56.023839 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-a69ecaeb-f5d3-48e7-a236-4ca120a4e000 req-ea435fac-d520-4df3-a7f5-9a1b8623c53c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030619 Jun 16 19:45:56.024643 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 160/323] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:45:56.038728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b32d4564-279f-4040-bcae-57d393295ec9 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:56.038728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b32d4564-279f-4040-bcae-57d393295ec9 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:56.038728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b32d4564-279f-4040-bcae-57d393295ec9 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:56.038728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b32d4564-279f-4040-bcae-57d393295ec9 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:56.039108 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b32d4564-279f-4040-bcae-57d393295ec9 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:56.039196 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b32d4564-279f-4040-bcae-57d393295ec9 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:56.146625 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=2 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:45:56.201265 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-efadd758-a547-4fc1-b5f5-93859d74d7d1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:45:56.201745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-efadd758-a547-4fc1-b5f5-93859d74d7d1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:45:56.202147 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-efadd758-a547-4fc1-b5f5-93859d74d7d1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:45:56.202553 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-efadd758-a547-4fc1-b5f5-93859d74d7d1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:45:56.202984 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-efadd758-a547-4fc1-b5f5-93859d74d7d1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:45:56.212834 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-efadd758-a547-4fc1-b5f5-93859d74d7d1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:56.213545 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-efadd758-a547-4fc1-b5f5-93859d74d7d1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:56.214350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-efadd758-a547-4fc1-b5f5-93859d74d7d1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:56.229070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-efadd758-a547-4fc1-b5f5-93859d74d7d1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:56.229400 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b32d4564-279f-4040-bcae-57d393295ec9 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:56.229400 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b32d4564-279f-4040-bcae-57d393295ec9 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1313 microversion: 2.1 time: 0.199955 Jun 16 19:45:56.229400 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 161/324] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:56 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:56.236689 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-efadd758-a547-4fc1-b5f5-93859d74d7d1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Getting quotas for project 47a4ab888dd74218ab5d7812ad095371. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:45:56.243704 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-efadd758-a547-4fc1-b5f5-93859d74d7d1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Getting quotas for user 4df05cbf303c4524a665b429f240a17a and project 47a4ab888dd74218ab5d7812ad095371. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:45:56.256033 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-efadd758-a547-4fc1-b5f5-93859d74d7d1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:45:56.258410 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-efadd758-a547-4fc1-b5f5-93859d74d7d1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcb2be6-02db-4853-a8d6-6478a75f26a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:45:56.410833 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-efadd758-a547-4fc1-b5f5-93859d74d7d1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.298472 Jun 16 19:45:56.412249 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 164/325] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:45:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:45:56.423681 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f5030be9-5c21-4b2c-86a5-89bfb1a38a72 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:56.424303 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f5030be9-5c21-4b2c-86a5-89bfb1a38a72 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:56.535216 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f5030be9-5c21-4b2c-86a5-89bfb1a38a72 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:56.547346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f5030be9-5c21-4b2c-86a5-89bfb1a38a72 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1241 microversion: 2.1 time: 0.129266 Jun 16 19:45:56.553315 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 162/326] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:56 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1241 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:56.554816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-93855e62-ecf1-412d-8709-eca58f0599f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:56.555469 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-93855e62-ecf1-412d-8709-eca58f0599f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:56.563703 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93855e62-ecf1-412d-8709-eca58f0599f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:56.564205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93855e62-ecf1-412d-8709-eca58f0599f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:56.565043 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93855e62-ecf1-412d-8709-eca58f0599f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:56.565483 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93855e62-ecf1-412d-8709-eca58f0599f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:56.715722 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-93855e62-ecf1-412d-8709-eca58f0599f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:56.724075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-93855e62-ecf1-412d-8709-eca58f0599f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:56.725575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-93855e62-ecf1-412d-8709-eca58f0599f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:56.726731 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-93855e62-ecf1-412d-8709-eca58f0599f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.180440 Jun 16 19:45:56.727309 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 165/327] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:45:56 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:45:56.834866 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-588f683d-82c6-415c-a6fb-b8339af78ac6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:56.835521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-588f683d-82c6-415c-a6fb-b8339af78ac6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:56.842802 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-588f683d-82c6-415c-a6fb-b8339af78ac6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:56.843414 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-588f683d-82c6-415c-a6fb-b8339af78ac6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:56.844306 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-588f683d-82c6-415c-a6fb-b8339af78ac6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:56.844744 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-588f683d-82c6-415c-a6fb-b8339af78ac6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:56.982459 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-588f683d-82c6-415c-a6fb-b8339af78ac6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:56.997308 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-588f683d-82c6-415c-a6fb-b8339af78ac6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1509 microversion: 2.1 time: 0.166115 Jun 16 19:45:56.998579 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 163/328] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:56 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:57.011749 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-83a29487-e0f2-4d6b-81e4-f4a718acb059 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:57.012359 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-83a29487-e0f2-4d6b-81e4-f4a718acb059 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:57.019030 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-83a29487-e0f2-4d6b-81e4-f4a718acb059 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:57.019586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-83a29487-e0f2-4d6b-81e4-f4a718acb059 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:57.020412 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-83a29487-e0f2-4d6b-81e4-f4a718acb059 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:57.020917 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-83a29487-e0f2-4d6b-81e4-f4a718acb059 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:57.245179 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-31ca38ee-1545-4e7c-bed6-4753790db168 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:57.246082 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-31ca38ee-1545-4e7c-bed6-4753790db168 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:57.256492 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-31ca38ee-1545-4e7c-bed6-4753790db168 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:57.257166 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-31ca38ee-1545-4e7c-bed6-4753790db168 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:57.258183 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-31ca38ee-1545-4e7c-bed6-4753790db168 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:57.258846 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-31ca38ee-1545-4e7c-bed6-4753790db168 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:57.385696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-83a29487-e0f2-4d6b-81e4-f4a718acb059 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:57.393170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-83a29487-e0f2-4d6b-81e4-f4a718acb059 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1318 microversion: 2.1 time: 0.385128 Jun 16 19:45:57.402846 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 166/329] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:57 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:57.504942 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-31ca38ee-1545-4e7c-bed6-4753790db168 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:57.512848 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-31ca38ee-1545-4e7c-bed6-4753790db168 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1313 microversion: 2.1 time: 0.271621 Jun 16 19:45:57.513444 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 164/330] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:57 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:57.568805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cfa9c4ad-005e-4a57-a030-02fe0200f0e2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:57.569670 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-cfa9c4ad-005e-4a57-a030-02fe0200f0e2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:57.575771 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cfa9c4ad-005e-4a57-a030-02fe0200f0e2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:57.576207 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cfa9c4ad-005e-4a57-a030-02fe0200f0e2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:57.576954 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cfa9c4ad-005e-4a57-a030-02fe0200f0e2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:57.577383 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cfa9c4ad-005e-4a57-a030-02fe0200f0e2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:57.670433 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cfa9c4ad-005e-4a57-a030-02fe0200f0e2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:57.679035 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cfa9c4ad-005e-4a57-a030-02fe0200f0e2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1245 microversion: 2.1 time: 0.113993 Jun 16 19:45:57.679928 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 167/331] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:57 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1245 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:57.747270 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-ae08ed59-136e-4fc8-ba7a-433dc16ac873 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:57.748042 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-ae08ed59-136e-4fc8-ba7a-433dc16ac873 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:57.756558 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ae08ed59-136e-4fc8-ba7a-433dc16ac873 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:57.756558 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ae08ed59-136e-4fc8-ba7a-433dc16ac873 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:57.756558 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ae08ed59-136e-4fc8-ba7a-433dc16ac873 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:57.756866 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ae08ed59-136e-4fc8-ba7a-433dc16ac873 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:57.968018 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ae08ed59-136e-4fc8-ba7a-433dc16ac873 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:57.975727 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ae08ed59-136e-4fc8-ba7a-433dc16ac873 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:57.977222 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ae08ed59-136e-4fc8-ba7a-433dc16ac873 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:57.978376 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-ae08ed59-136e-4fc8-ba7a-433dc16ac873 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.235906 Jun 16 19:45:57.978948 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 165/332] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:45:57 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:45:58.014334 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cc8a35dd-871b-4355-93a3-f8ceef1d2577 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:58.014968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-cc8a35dd-871b-4355-93a3-f8ceef1d2577 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:58.021003 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cc8a35dd-871b-4355-93a3-f8ceef1d2577 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:58.021449 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cc8a35dd-871b-4355-93a3-f8ceef1d2577 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:58.027763 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cc8a35dd-871b-4355-93a3-f8ceef1d2577 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:58.027763 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cc8a35dd-871b-4355-93a3-f8ceef1d2577 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:58.160360 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cc8a35dd-871b-4355-93a3-f8ceef1d2577 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:58.168506 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cc8a35dd-871b-4355-93a3-f8ceef1d2577 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1509 microversion: 2.1 time: 0.157925 Jun 16 19:45:58.169637 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 168/333] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:58 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:58.410357 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-49605dd4-dfd6-438e-917c-b1f2a3e9c5da tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:58.411192 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-49605dd4-dfd6-438e-917c-b1f2a3e9c5da tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:58.425430 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-49605dd4-dfd6-438e-917c-b1f2a3e9c5da tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:58.425430 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-49605dd4-dfd6-438e-917c-b1f2a3e9c5da tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:58.425430 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-49605dd4-dfd6-438e-917c-b1f2a3e9c5da tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:58.425430 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-49605dd4-dfd6-438e-917c-b1f2a3e9c5da tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:58.529997 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3c3a493d-10d2-492a-a015-2be085bd7ed8 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:58.530740 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3c3a493d-10d2-492a-a015-2be085bd7ed8 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:58.539291 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3c3a493d-10d2-492a-a015-2be085bd7ed8 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:58.540266 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3c3a493d-10d2-492a-a015-2be085bd7ed8 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:58.542414 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3c3a493d-10d2-492a-a015-2be085bd7ed8 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:58.545971 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3c3a493d-10d2-492a-a015-2be085bd7ed8 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:58.606174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-49605dd4-dfd6-438e-917c-b1f2a3e9c5da tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:58.616421 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-49605dd4-dfd6-438e-917c-b1f2a3e9c5da tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1318 microversion: 2.1 time: 0.209035 Jun 16 19:45:58.618965 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 166/334] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:58 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:45:58.695645 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-179e138e-722d-43a1-9500-60a607c2638e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:58.696558 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-179e138e-722d-43a1-9500-60a607c2638e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:58.710189 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-179e138e-722d-43a1-9500-60a607c2638e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:58.710894 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-179e138e-722d-43a1-9500-60a607c2638e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:58.711860 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-179e138e-722d-43a1-9500-60a607c2638e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:58.712626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-179e138e-722d-43a1-9500-60a607c2638e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:58.744855 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3c3a493d-10d2-492a-a015-2be085bd7ed8 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:58.769758 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3c3a493d-10d2-492a-a015-2be085bd7ed8 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1313 microversion: 2.1 time: 0.243939 Jun 16 19:45:58.779721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 169/335] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:58 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:45:58.798032 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-179e138e-722d-43a1-9500-60a607c2638e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:58.805908 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-179e138e-722d-43a1-9500-60a607c2638e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1245 microversion: 2.1 time: 0.114194 Jun 16 19:45:58.806595 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 167/336] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:58 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1245 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:45:58.998903 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3d648536-be9a-4fe3-b22a-3f2bf3897df7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:58.998903 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3d648536-be9a-4fe3-b22a-3f2bf3897df7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:59.006887 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d648536-be9a-4fe3-b22a-3f2bf3897df7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:59.007476 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d648536-be9a-4fe3-b22a-3f2bf3897df7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:59.008319 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d648536-be9a-4fe3-b22a-3f2bf3897df7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:59.008823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d648536-be9a-4fe3-b22a-3f2bf3897df7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:59.179606 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3d648536-be9a-4fe3-b22a-3f2bf3897df7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:59.189730 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-afb2795c-dd4f-4f95-bba1-d1b19d50c087 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:59.190422 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-afb2795c-dd4f-4f95-bba1-d1b19d50c087 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:59.194899 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3d648536-be9a-4fe3-b22a-3f2bf3897df7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:59.197532 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3d648536-be9a-4fe3-b22a-3f2bf3897df7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:59.200238 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-afb2795c-dd4f-4f95-bba1-d1b19d50c087 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:59.200238 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-afb2795c-dd4f-4f95-bba1-d1b19d50c087 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:59.200238 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-afb2795c-dd4f-4f95-bba1-d1b19d50c087 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:59.200572 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-afb2795c-dd4f-4f95-bba1-d1b19d50c087 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:59.202331 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3d648536-be9a-4fe3-b22a-3f2bf3897df7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.205232 Jun 16 19:45:59.203375 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 170/337] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:45:58 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:45:59.370855 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-afb2795c-dd4f-4f95-bba1-d1b19d50c087 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:59.380431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-afb2795c-dd4f-4f95-bba1-d1b19d50c087 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1509 microversion: 2.1 time: 0.194827 Jun 16 19:45:59.381179 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 168/338] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:59 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:59.633382 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-74d00c3b-80cb-4251-b03f-49d273238ed7 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:59.633983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-74d00c3b-80cb-4251-b03f-49d273238ed7 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:59.641032 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74d00c3b-80cb-4251-b03f-49d273238ed7 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:59.641476 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74d00c3b-80cb-4251-b03f-49d273238ed7 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:59.642246 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74d00c3b-80cb-4251-b03f-49d273238ed7 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:59.642676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74d00c3b-80cb-4251-b03f-49d273238ed7 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:59.788294 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-acd1e2b6-cc27-46b7-a2ec-26d0ced04a31 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:59.788826 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-acd1e2b6-cc27-46b7-a2ec-26d0ced04a31 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:59.801513 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-acd1e2b6-cc27-46b7-a2ec-26d0ced04a31 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:59.802321 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-acd1e2b6-cc27-46b7-a2ec-26d0ced04a31 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:59.802789 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-acd1e2b6-cc27-46b7-a2ec-26d0ced04a31 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:59.805556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-acd1e2b6-cc27-46b7-a2ec-26d0ced04a31 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:59.846508 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-74d00c3b-80cb-4251-b03f-49d273238ed7 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:59.854207 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-74d00c3b-80cb-4251-b03f-49d273238ed7 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1318 microversion: 2.1 time: 0.224624 Jun 16 19:45:59.854823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 171/339] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:59 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:59.868007 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4b3a683b-889e-43c2-8f87-246b4d70a452 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:45:59.868892 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4b3a683b-889e-43c2-8f87-246b4d70a452 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:45:59.874864 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4b3a683b-889e-43c2-8f87-246b4d70a452 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:59.875349 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4b3a683b-889e-43c2-8f87-246b4d70a452 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:59.876182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4b3a683b-889e-43c2-8f87-246b4d70a452 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:45:59.876793 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4b3a683b-889e-43c2-8f87-246b4d70a452 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:45:59.943440 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4b3a683b-889e-43c2-8f87-246b4d70a452 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:59.952101 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4b3a683b-889e-43c2-8f87-246b4d70a452 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1237 microversion: 2.1 time: 0.093884 Jun 16 19:45:59.952687 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 172/340] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:59 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1237 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:45:59.991837 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-acd1e2b6-cc27-46b7-a2ec-26d0ced04a31 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:45:59.999718 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-acd1e2b6-cc27-46b7-a2ec-26d0ced04a31 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1313 microversion: 2.1 time: 0.216356 Jun 16 19:46:00.000817 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 169/341] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:45:59 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:00.223048 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b061036b-c1ec-4b37-903b-b6c40c2db95d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:00.223921 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b061036b-c1ec-4b37-903b-b6c40c2db95d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:00.230135 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b061036b-c1ec-4b37-903b-b6c40c2db95d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:00.231977 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b061036b-c1ec-4b37-903b-b6c40c2db95d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:00.231977 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b061036b-c1ec-4b37-903b-b6c40c2db95d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:00.231977 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b061036b-c1ec-4b37-903b-b6c40c2db95d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:00.382159 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b061036b-c1ec-4b37-903b-b6c40c2db95d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:00.394610 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b061036b-c1ec-4b37-903b-b6c40c2db95d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:00.395131 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b061036b-c1ec-4b37-903b-b6c40c2db95d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:00.396426 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b061036b-c1ec-4b37-903b-b6c40c2db95d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.178831 Jun 16 19:46:00.398356 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 173/342] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:00 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:00.405973 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5b9aa29b-8c54-4fed-9535-faec978fc482 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:00.405973 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5b9aa29b-8c54-4fed-9535-faec978fc482 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:00.407472 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5b9aa29b-8c54-4fed-9535-faec978fc482 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:00.408216 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5b9aa29b-8c54-4fed-9535-faec978fc482 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:00.409003 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5b9aa29b-8c54-4fed-9535-faec978fc482 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:00.409446 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5b9aa29b-8c54-4fed-9535-faec978fc482 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:00.558328 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5b9aa29b-8c54-4fed-9535-faec978fc482 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:00.567460 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5b9aa29b-8c54-4fed-9535-faec978fc482 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1509 microversion: 2.1 time: 0.170895 Jun 16 19:46:00.567460 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 170/343] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:00 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:00.876850 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7e3b8903-39cc-4491-b9bb-a0f600270470 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:00.877678 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7e3b8903-39cc-4491-b9bb-a0f600270470 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:00.894597 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7e3b8903-39cc-4491-b9bb-a0f600270470 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:00.895066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7e3b8903-39cc-4491-b9bb-a0f600270470 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:00.895835 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7e3b8903-39cc-4491-b9bb-a0f600270470 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:00.896270 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7e3b8903-39cc-4491-b9bb-a0f600270470 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:00.977964 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1cf242b8-4081-44ce-926b-a905737527e3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:00.986895 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-1cf242b8-4081-44ce-926b-a905737527e3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:00.988127 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1cf242b8-4081-44ce-926b-a905737527e3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:00.988835 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1cf242b8-4081-44ce-926b-a905737527e3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:00.989859 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1cf242b8-4081-44ce-926b-a905737527e3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:00.990296 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1cf242b8-4081-44ce-926b-a905737527e3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:01.045150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7e3b8903-39cc-4491-b9bb-a0f600270470 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:01.056543 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7e3b8903-39cc-4491-b9bb-a0f600270470 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1507 microversion: 2.1 time: 0.188654 Jun 16 19:46:01.057342 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 174/344] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:00 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:01.062975 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-613fdc54-0867-4de3-a317-53cb5248d5a7 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:01.063748 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-613fdc54-0867-4de3-a317-53cb5248d5a7 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:01.072346 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-613fdc54-0867-4de3-a317-53cb5248d5a7 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:01.072831 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-613fdc54-0867-4de3-a317-53cb5248d5a7 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:01.073656 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-613fdc54-0867-4de3-a317-53cb5248d5a7 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:01.074091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-613fdc54-0867-4de3-a317-53cb5248d5a7 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:01.106389 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1cf242b8-4081-44ce-926b-a905737527e3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:01.115758 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-1cf242b8-4081-44ce-926b-a905737527e3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1293 microversion: 2.1 time: 0.150860 Jun 16 19:46:01.116327 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 171/345] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:00 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1293 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:01.248246 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-613fdc54-0867-4de3-a317-53cb5248d5a7 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:01.260681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-613fdc54-0867-4de3-a317-53cb5248d5a7 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1313 microversion: 2.1 time: 0.202057 Jun 16 19:46:01.261634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 175/346] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:01 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:01.423142 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-dc3e082f-da8d-4606-952b-17037aeb1b6b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:01.423760 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-dc3e082f-da8d-4606-952b-17037aeb1b6b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:01.432375 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-dc3e082f-da8d-4606-952b-17037aeb1b6b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:01.433025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-dc3e082f-da8d-4606-952b-17037aeb1b6b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:01.433591 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-dc3e082f-da8d-4606-952b-17037aeb1b6b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:01.434029 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-dc3e082f-da8d-4606-952b-17037aeb1b6b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:01.436808 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-139ee6fd-506d-442c-9682-4fb2af1885e9 req-f9cc2366-d30e-4def-9ee5-949bc58adcb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8add5e-2cff-4707-b035-9db6bfdf812c", "name": "network-vif-plugged", "status": "completed", "tag": "7fcade0a-4088-4731-8a34-571360d83e6d"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:01.447340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-139ee6fd-506d-442c-9682-4fb2af1885e9 req-f9cc2366-d30e-4def-9ee5-949bc58adcb0 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:01.449722 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-139ee6fd-506d-442c-9682-4fb2af1885e9 req-f9cc2366-d30e-4def-9ee5-949bc58adcb0 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:01.461860 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-139ee6fd-506d-442c-9682-4fb2af1885e9 req-f9cc2366-d30e-4def-9ee5-949bc58adcb0 service nova] Creating event network-vif-plugged:7fcade0a-4088-4731-8a34-571360d83e6d for instance 5d8add5e-2cff-4707-b035-9db6bfdf812c on hv-cinder-84617 Jun 16 19:46:01.467192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-139ee6fd-506d-442c-9682-4fb2af1885e9 req-f9cc2366-d30e-4def-9ee5-949bc58adcb0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034922 Jun 16 19:46:01.468142 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 176/347] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:46:01.587667 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5aa77099-fad9-4418-9d7d-2ea7642face1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:01.588490 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5aa77099-fad9-4418-9d7d-2ea7642face1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:01.596504 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5aa77099-fad9-4418-9d7d-2ea7642face1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:01.596950 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5aa77099-fad9-4418-9d7d-2ea7642face1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:01.600216 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-dc3e082f-da8d-4606-952b-17037aeb1b6b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:01.610476 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5aa77099-fad9-4418-9d7d-2ea7642face1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:01.610476 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5aa77099-fad9-4418-9d7d-2ea7642face1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:01.614741 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-dc3e082f-da8d-4606-952b-17037aeb1b6b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:01.616368 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-dc3e082f-da8d-4606-952b-17037aeb1b6b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:01.617565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-dc3e082f-da8d-4606-952b-17037aeb1b6b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.199435 Jun 16 19:46:01.618113 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 172/348] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:01 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:01.778769 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5aa77099-fad9-4418-9d7d-2ea7642face1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:01.786215 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5aa77099-fad9-4418-9d7d-2ea7642face1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1515 microversion: 2.1 time: 0.205242 Jun 16 19:46:01.786832 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 177/349] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:01 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1515 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:02.132343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-4c79cca7-bc04-4ddc-b1fc-900b88752bd2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:02.132943 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-4c79cca7-bc04-4ddc-b1fc-900b88752bd2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:02.139673 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4c79cca7-bc04-4ddc-b1fc-900b88752bd2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:02.140143 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4c79cca7-bc04-4ddc-b1fc-900b88752bd2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:02.140947 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4c79cca7-bc04-4ddc-b1fc-900b88752bd2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:02.141941 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4c79cca7-bc04-4ddc-b1fc-900b88752bd2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:02.146260 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:02.228177 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-4c79cca7-bc04-4ddc-b1fc-900b88752bd2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:02.235896 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-4c79cca7-bc04-4ddc-b1fc-900b88752bd2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1301 microversion: 2.1 time: 0.107352 Jun 16 19:46:02.236596 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 173/350] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:02 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1301 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:02.277425 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9e764a92-794c-47a3-86fe-09206851f002 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:02.279670 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9e764a92-794c-47a3-86fe-09206851f002 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:02.286947 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9e764a92-794c-47a3-86fe-09206851f002 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:02.287577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9e764a92-794c-47a3-86fe-09206851f002 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:02.288705 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9e764a92-794c-47a3-86fe-09206851f002 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:02.289293 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9e764a92-794c-47a3-86fe-09206851f002 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:02.455000 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9e764a92-794c-47a3-86fe-09206851f002 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:02.462908 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9e764a92-794c-47a3-86fe-09206851f002 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1313 microversion: 2.1 time: 0.189297 Jun 16 19:46:02.463503 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 178/351] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:02 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:02.636604 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0800afb7-fcba-4372-a900-25d7ce1f4797 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:02.637482 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0800afb7-fcba-4372-a900-25d7ce1f4797 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:02.639934 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:02.645660 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0800afb7-fcba-4372-a900-25d7ce1f4797 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:02.646342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0800afb7-fcba-4372-a900-25d7ce1f4797 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:02.648522 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0800afb7-fcba-4372-a900-25d7ce1f4797 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:02.648958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0800afb7-fcba-4372-a900-25d7ce1f4797 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:02.842113 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0800afb7-fcba-4372-a900-25d7ce1f4797 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:02.851281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0800afb7-fcba-4372-a900-25d7ce1f4797 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:02.852860 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0800afb7-fcba-4372-a900-25d7ce1f4797 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:02.854259 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0800afb7-fcba-4372-a900-25d7ce1f4797 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.221586 Jun 16 19:46:02.855328 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 174/352] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:02 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:03.259221 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0eb940c9-6dbf-4981-8fa2-ad04d9a45fb2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:03.260019 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0eb940c9-6dbf-4981-8fa2-ad04d9a45fb2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:03.279299 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0eb940c9-6dbf-4981-8fa2-ad04d9a45fb2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:03.282528 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0eb940c9-6dbf-4981-8fa2-ad04d9a45fb2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:03.283391 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0eb940c9-6dbf-4981-8fa2-ad04d9a45fb2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:03.283836 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0eb940c9-6dbf-4981-8fa2-ad04d9a45fb2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:03.456766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0eb940c9-6dbf-4981-8fa2-ad04d9a45fb2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:03.460389 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:03.469378 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0eb940c9-6dbf-4981-8fa2-ad04d9a45fb2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1367 microversion: 2.1 time: 0.214134 Jun 16 19:46:03.480010 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 179/353] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:03 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:03.484775 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e5e679a6-5be0-46d4-9d47-560748fd128f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:03.485458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e5e679a6-5be0-46d4-9d47-560748fd128f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:03.492199 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e5e679a6-5be0-46d4-9d47-560748fd128f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:03.492721 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e5e679a6-5be0-46d4-9d47-560748fd128f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:03.493554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e5e679a6-5be0-46d4-9d47-560748fd128f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:03.494181 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e5e679a6-5be0-46d4-9d47-560748fd128f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:03.672869 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e5e679a6-5be0-46d4-9d47-560748fd128f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:03.680246 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e5e679a6-5be0-46d4-9d47-560748fd128f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1313 microversion: 2.1 time: 0.204256 Jun 16 19:46:03.680919 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 175/354] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:03 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:03.873268 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-93fcd551-3c40-4baa-81cc-88c06f0002a8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:03.873867 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-93fcd551-3c40-4baa-81cc-88c06f0002a8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:03.884052 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93fcd551-3c40-4baa-81cc-88c06f0002a8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:03.884052 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93fcd551-3c40-4baa-81cc-88c06f0002a8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:03.884052 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93fcd551-3c40-4baa-81cc-88c06f0002a8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:03.884052 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93fcd551-3c40-4baa-81cc-88c06f0002a8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:04.020699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-93fcd551-3c40-4baa-81cc-88c06f0002a8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:04.028626 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-93fcd551-3c40-4baa-81cc-88c06f0002a8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:04.030070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-93fcd551-3c40-4baa-81cc-88c06f0002a8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:04.031252 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-93fcd551-3c40-4baa-81cc-88c06f0002a8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.162540 Jun 16 19:46:04.031814 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 180/355] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:03 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:04.493723 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-12413396-67a3-40f6-922a-75b271748c01 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:04.494423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-12413396-67a3-40f6-922a-75b271748c01 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:04.502144 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-56332fba-11ba-46de-a315-4fc5efd90986 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Action: 'create', calling method: .version_select at 0x7f05017a4940>, body: {"keypair": {"name": "tempest-keypair-1482909140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnYpsCQs0U7UUuYrGa+uPhyUEHkhcHU/P4HegORB/iTVzmJ96389Q64MvHlZ4TPqf0ZeOymCodBwr91oupBm9F2/aByEAnPX9wgA06sk6J6aSp7SH4EzbKyt/pjWN/osA=="}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:04.513545 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-12413396-67a3-40f6-922a-75b271748c01 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:04.517860 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:04.518625 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-12413396-67a3-40f6-922a-75b271748c01 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:04.519468 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-12413396-67a3-40f6-922a-75b271748c01 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:04.519914 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-12413396-67a3-40f6-922a-75b271748c01 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:04.523745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=19 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:04.540938 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-56332fba-11ba-46de-a315-4fc5efd90986 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Getting quotas for project 7153c09b2d0b4805ad0360afb7ecd3ca. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:46:04.552792 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-56332fba-11ba-46de-a315-4fc5efd90986 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Getting quotas for user 2d0d5723417d4b60bc51e47f28d09902 and project 7153c09b2d0b4805ad0360afb7ecd3ca. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:46:04.714264 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-56332fba-11ba-46de-a315-4fc5efd90986 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.216272 Jun 16 19:46:04.715171 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 181/356] 10.222.0.36 () {60 vars in 1158 bytes} [Thu Jun 16 19:46:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:46:04.731913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-8f62844b-4c42-4ee6-9470-50722abdc2e8 req-a52669a8-24d3-49e7-84e3-8d6f27ab010b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb16dee5-a334-4d62-8b28-cd5a9632b6cc", "tag": "b303c9b9-b850-4aed-b10c-081efef3620f"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:04.750361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-8f62844b-4c42-4ee6-9470-50722abdc2e8 req-a52669a8-24d3-49e7-84e3-8d6f27ab010b service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:04.751111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-8f62844b-4c42-4ee6-9470-50722abdc2e8 req-a52669a8-24d3-49e7-84e3-8d6f27ab010b service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:04.768736 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-8f62844b-4c42-4ee6-9470-50722abdc2e8 req-a52669a8-24d3-49e7-84e3-8d6f27ab010b service nova] Creating event network-changed:b303c9b9-b850-4aed-b10c-081efef3620f for instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc on hv-cinder-84617 Jun 16 19:46:04.775643 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-8f62844b-4c42-4ee6-9470-50722abdc2e8 req-a52669a8-24d3-49e7-84e3-8d6f27ab010b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048662 Jun 16 19:46:04.776662 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 182/357] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:46:04.788243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7881d691-4b1f-433d-a266-2c3a9027a223 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:04.788243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7881d691-4b1f-433d-a266-2c3a9027a223 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:04.802095 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7881d691-4b1f-433d-a266-2c3a9027a223 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:04.804090 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-12413396-67a3-40f6-922a-75b271748c01 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:04.805437 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7881d691-4b1f-433d-a266-2c3a9027a223 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:04.806267 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7881d691-4b1f-433d-a266-2c3a9027a223 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:04.806705 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7881d691-4b1f-433d-a266-2c3a9027a223 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:04.814336 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-12413396-67a3-40f6-922a-75b271748c01 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1367 microversion: 2.1 time: 0.324832 Jun 16 19:46:04.815492 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 176/358] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:04 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1367 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:04.974024 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7881d691-4b1f-433d-a266-2c3a9027a223 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:04.982566 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7881d691-4b1f-433d-a266-2c3a9027a223 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1496 microversion: 2.1 time: 0.201824 Jun 16 19:46:04.983174 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 183/359] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:04 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1496 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:05.049873 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5540f7d8-a2cb-4de1-8d1d-a824c3f68554 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:05.050406 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5540f7d8-a2cb-4de1-8d1d-a824c3f68554 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:05.056650 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5540f7d8-a2cb-4de1-8d1d-a824c3f68554 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:05.057097 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5540f7d8-a2cb-4de1-8d1d-a824c3f68554 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:05.057861 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5540f7d8-a2cb-4de1-8d1d-a824c3f68554 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:05.058304 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5540f7d8-a2cb-4de1-8d1d-a824c3f68554 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:05.256420 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5540f7d8-a2cb-4de1-8d1d-a824c3f68554 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:05.264681 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5540f7d8-a2cb-4de1-8d1d-a824c3f68554 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:05.266186 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5540f7d8-a2cb-4de1-8d1d-a824c3f68554 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:05.267454 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5540f7d8-a2cb-4de1-8d1d-a824c3f68554 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.221914 Jun 16 19:46:05.268003 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 177/360] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:05 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:05.831796 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ee852021-a907-4041-936d-1e07a5c93986 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:05.832597 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ee852021-a907-4041-936d-1e07a5c93986 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:05.839582 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ee852021-a907-4041-936d-1e07a5c93986 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:05.840119 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ee852021-a907-4041-936d-1e07a5c93986 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:05.841494 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ee852021-a907-4041-936d-1e07a5c93986 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:05.842004 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ee852021-a907-4041-936d-1e07a5c93986 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:06.017755 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ee852021-a907-4041-936d-1e07a5c93986 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:06.022974 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ee852021-a907-4041-936d-1e07a5c93986 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1367 microversion: 2.1 time: 0.195006 Jun 16 19:46:06.023489 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 184/361] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:05 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:06.285857 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bfa92a6b-3fd0-493b-a0d2-634b6bcf61b8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:06.286490 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-bfa92a6b-3fd0-493b-a0d2-634b6bcf61b8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:06.292963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bfa92a6b-3fd0-493b-a0d2-634b6bcf61b8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:06.293401 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bfa92a6b-3fd0-493b-a0d2-634b6bcf61b8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:06.294239 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bfa92a6b-3fd0-493b-a0d2-634b6bcf61b8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:06.294729 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bfa92a6b-3fd0-493b-a0d2-634b6bcf61b8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:06.438826 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-bfa92a6b-3fd0-493b-a0d2-634b6bcf61b8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:06.447267 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-bfa92a6b-3fd0-493b-a0d2-634b6bcf61b8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:06.448748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-bfa92a6b-3fd0-493b-a0d2-634b6bcf61b8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:06.449929 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-bfa92a6b-3fd0-493b-a0d2-634b6bcf61b8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.167917 Jun 16 19:46:06.451073 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 178/362] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:06 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:46:06.585749 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-af4dcc63-2f57-4e4e-98aa-f1724a00a67d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:06.586565 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-af4dcc63-2f57-4e4e-98aa-f1724a00a67d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:06.589354 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:06.595136 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-af4dcc63-2f57-4e4e-98aa-f1724a00a67d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:06.599330 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-af4dcc63-2f57-4e4e-98aa-f1724a00a67d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:06.599330 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-af4dcc63-2f57-4e4e-98aa-f1724a00a67d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:06.599330 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-af4dcc63-2f57-4e4e-98aa-f1724a00a67d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:06.742018 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-af4dcc63-2f57-4e4e-98aa-f1724a00a67d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Going to try to terminate instance {{(pid=124550) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:46:07.040498 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c938196b-0f13-46bb-bb7e-0367a2688f7c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:07.041241 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c938196b-0f13-46bb-bb7e-0367a2688f7c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:07.043476 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=14 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:07.049543 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c938196b-0f13-46bb-bb7e-0367a2688f7c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:07.050099 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c938196b-0f13-46bb-bb7e-0367a2688f7c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:07.050999 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c938196b-0f13-46bb-bb7e-0367a2688f7c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:07.051483 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c938196b-0f13-46bb-bb7e-0367a2688f7c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:07.282651 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-af4dcc63-2f57-4e4e-98aa-f1724a00a67d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 204 len: 0 microversion: 2.1 time: 0.700341 Jun 16 19:46:07.283244 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 185/363] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:46:06 2022] DELETE /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 0 bytes in 702 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:46:07.291582 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d9d646ca-c031-4fec-83ab-7e911775fd25 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:07.297409 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d9d646ca-c031-4fec-83ab-7e911775fd25 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:07.298766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d9d646ca-c031-4fec-83ab-7e911775fd25 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:07.299253 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d9d646ca-c031-4fec-83ab-7e911775fd25 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:07.300058 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d9d646ca-c031-4fec-83ab-7e911775fd25 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:07.300489 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d9d646ca-c031-4fec-83ab-7e911775fd25 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:07.309373 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c938196b-0f13-46bb-bb7e-0367a2688f7c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:07.316600 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c938196b-0f13-46bb-bb7e-0367a2688f7c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1367 microversion: 2.1 time: 0.279858 Jun 16 19:46:07.317147 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 179/364] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:07 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:07.468547 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5674f571-2abb-4867-bef5-e955145d801d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:07.469179 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5674f571-2abb-4867-bef5-e955145d801d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:07.476337 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5674f571-2abb-4867-bef5-e955145d801d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:07.476781 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5674f571-2abb-4867-bef5-e955145d801d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:07.477875 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5674f571-2abb-4867-bef5-e955145d801d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:07.478618 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5674f571-2abb-4867-bef5-e955145d801d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:07.528365 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d9d646ca-c031-4fec-83ab-7e911775fd25 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:07.536848 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d9d646ca-c031-4fec-83ab-7e911775fd25 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1502 microversion: 2.1 time: 0.249151 Jun 16 19:46:07.538028 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 186/365] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:07 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1502 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:07.614295 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5674f571-2abb-4867-bef5-e955145d801d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:07.624482 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5674f571-2abb-4867-bef5-e955145d801d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:07.624482 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5674f571-2abb-4867-bef5-e955145d801d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:07.625681 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5674f571-2abb-4867-bef5-e955145d801d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.161595 Jun 16 19:46:07.626227 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 180/366] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:07 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:08.092456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5698f689-e0d7-4122-9639-4f6add93b15c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1013798226", "imageRef": "9fcb2be6-02db-4853-a8d6-6478a75f26a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c1db9f4-758f-4b75-b0a9-1383e34ed987"}], "security_groups": [{"name": "tempest-securitygroup--806100383"}], "key_name": "tempest-keypair-1482909140", "user_data": "}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:08.205181 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-5698f689-e0d7-4122-9639-4f6add93b15c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] validate_networks() for [('4c1db9f4-758f-4b75-b0a9-1383e34ed987', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:46:08.333857 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-89a9426c-4565-420e-839f-08f12658335a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:08.334411 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-89a9426c-4565-420e-839f-08f12658335a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:08.341926 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-89a9426c-4565-420e-839f-08f12658335a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:08.342629 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-89a9426c-4565-420e-839f-08f12658335a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:08.343445 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-89a9426c-4565-420e-839f-08f12658335a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:08.344042 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-89a9426c-4565-420e-839f-08f12658335a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:08.493265 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-89a9426c-4565-420e-839f-08f12658335a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:08.503224 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-89a9426c-4565-420e-839f-08f12658335a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1367 microversion: 2.1 time: 0.171037 Jun 16 19:46:08.507158 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 181/367] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:08 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:08.558338 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e087c947-3266-47a3-9172-c52e4e6b43be tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:08.561319 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e087c947-3266-47a3-9172-c52e4e6b43be tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:08.569538 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e087c947-3266-47a3-9172-c52e4e6b43be tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:08.571430 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e087c947-3266-47a3-9172-c52e4e6b43be tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:08.573226 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e087c947-3266-47a3-9172-c52e4e6b43be tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:08.574231 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e087c947-3266-47a3-9172-c52e4e6b43be tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:08.726293 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e087c947-3266-47a3-9172-c52e4e6b43be tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:08.734867 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e087c947-3266-47a3-9172-c52e4e6b43be tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1502 microversion: 2.1 time: 0.182535 Jun 16 19:46:08.735646 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 182/368] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:08 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1502 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:08.740852 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5cc93400-8424-4ca6-b442-3e6a8e90d6e0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:08.741554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5cc93400-8424-4ca6-b442-3e6a8e90d6e0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:08.749094 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5cc93400-8424-4ca6-b442-3e6a8e90d6e0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:08.749995 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5cc93400-8424-4ca6-b442-3e6a8e90d6e0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:08.751027 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5cc93400-8424-4ca6-b442-3e6a8e90d6e0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:08.760273 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5cc93400-8424-4ca6-b442-3e6a8e90d6e0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:08.826284 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-5698f689-e0d7-4122-9639-4f6add93b15c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:46:08.826857 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-5698f689-e0d7-4122-9639-4f6add93b15c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:46:08.827271 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-5698f689-e0d7-4122-9639-4f6add93b15c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:46:08.827693 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-5698f689-e0d7-4122-9639-4f6add93b15c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:46:08.828101 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-5698f689-e0d7-4122-9639-4f6add93b15c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:46:08.837763 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5698f689-e0d7-4122-9639-4f6add93b15c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:08.838214 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5698f689-e0d7-4122-9639-4f6add93b15c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:08.839136 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5698f689-e0d7-4122-9639-4f6add93b15c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:08.839572 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5698f689-e0d7-4122-9639-4f6add93b15c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:08.860146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-5698f689-e0d7-4122-9639-4f6add93b15c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Getting quotas for project 7153c09b2d0b4805ad0360afb7ecd3ca. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:46:08.864206 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-5698f689-e0d7-4122-9639-4f6add93b15c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Getting quotas for user 2d0d5723417d4b60bc51e47f28d09902 and project 7153c09b2d0b4805ad0360afb7ecd3ca. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:46:08.875777 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5698f689-e0d7-4122-9639-4f6add93b15c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:46:08.878066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5698f689-e0d7-4122-9639-4f6add93b15c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcb2be6-02db-4853-a8d6-6478a75f26a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:46:08.928724 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5cc93400-8424-4ca6-b442-3e6a8e90d6e0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:08.937445 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5cc93400-8424-4ca6-b442-3e6a8e90d6e0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:08.939124 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5cc93400-8424-4ca6-b442-3e6a8e90d6e0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:08.940703 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5cc93400-8424-4ca6-b442-3e6a8e90d6e0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.203971 Jun 16 19:46:08.941260 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 183/369] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:08 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:09.132797 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5698f689-e0d7-4122-9639-4f6add93b15c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.044535 Jun 16 19:46:09.133548 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 187/370] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:46:08 2022] POST /compute/v2.1/servers => generated 408 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:46:09.144933 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-2ead0cb2-fb95-4e41-8785-85111586d52e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:09.145865 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-2ead0cb2-fb95-4e41-8785-85111586d52e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:09.245737 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-2ead0cb2-fb95-4e41-8785-85111586d52e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:09.264016 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-2ead0cb2-fb95-4e41-8785-85111586d52e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1246 microversion: 2.1 time: 0.124354 Jun 16 19:46:09.264611 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 184/371] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:09 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1246 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:09.524085 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-40af317b-883d-4390-ba69-30db84c02543 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:09.524700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-40af317b-883d-4390-ba69-30db84c02543 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:09.531657 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-40af317b-883d-4390-ba69-30db84c02543 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:09.532099 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-40af317b-883d-4390-ba69-30db84c02543 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:09.532856 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-40af317b-883d-4390-ba69-30db84c02543 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:09.533285 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-40af317b-883d-4390-ba69-30db84c02543 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:09.740658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-40af317b-883d-4390-ba69-30db84c02543 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:09.752220 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-4e98b8df-2cf5-41c2-9d7e-a06d70aa3049 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:09.752823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-40af317b-883d-4390-ba69-30db84c02543 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1367 microversion: 2.1 time: 0.232370 Jun 16 19:46:09.752927 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-4e98b8df-2cf5-41c2-9d7e-a06d70aa3049 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:09.753445 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 188/372] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:09 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:09.759959 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4e98b8df-2cf5-41c2-9d7e-a06d70aa3049 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:09.760829 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4e98b8df-2cf5-41c2-9d7e-a06d70aa3049 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:09.761847 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4e98b8df-2cf5-41c2-9d7e-a06d70aa3049 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:09.765335 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4e98b8df-2cf5-41c2-9d7e-a06d70aa3049 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:09.920044 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-4e98b8df-2cf5-41c2-9d7e-a06d70aa3049 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:09.928119 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-4e98b8df-2cf5-41c2-9d7e-a06d70aa3049 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1460 microversion: 2.1 time: 0.179472 Jun 16 19:46:09.937390 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 185/373] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:09 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1460 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:09.960489 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e7742542-fa64-42a9-b99e-6202a6705c08 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:09.961665 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e7742542-fa64-42a9-b99e-6202a6705c08 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:09.972376 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e7742542-fa64-42a9-b99e-6202a6705c08 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:09.972823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e7742542-fa64-42a9-b99e-6202a6705c08 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:09.973690 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e7742542-fa64-42a9-b99e-6202a6705c08 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:09.974106 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e7742542-fa64-42a9-b99e-6202a6705c08 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:10.003617 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-9f30ca18-a818-4a3a-8b77-f47fe26fc7fb req-f2add9eb-db19-45b9-a95c-f2d3ec6ddeec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8add5e-2cff-4707-b035-9db6bfdf812c", "name": "network-vif-deleted", "tag": "7fcade0a-4088-4731-8a34-571360d83e6d"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:10.033443 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-9f30ca18-a818-4a3a-8b77-f47fe26fc7fb req-f2add9eb-db19-45b9-a95c-f2d3ec6ddeec service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:10.034428 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-9f30ca18-a818-4a3a-8b77-f47fe26fc7fb req-f2add9eb-db19-45b9-a95c-f2d3ec6ddeec service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:10.061326 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-9f30ca18-a818-4a3a-8b77-f47fe26fc7fb req-f2add9eb-db19-45b9-a95c-f2d3ec6ddeec service nova] Creating event network-vif-deleted:7fcade0a-4088-4731-8a34-571360d83e6d for instance 5d8add5e-2cff-4707-b035-9db6bfdf812c on hv-cinder-84617 Jun 16 19:46:10.069493 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-9f30ca18-a818-4a3a-8b77-f47fe26fc7fb req-f2add9eb-db19-45b9-a95c-f2d3ec6ddeec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069884 Jun 16 19:46:10.072452 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 186/374] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:46:10.204851 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e7742542-fa64-42a9-b99e-6202a6705c08 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:10.213371 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e7742542-fa64-42a9-b99e-6202a6705c08 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:10.214961 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e7742542-fa64-42a9-b99e-6202a6705c08 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:10.216281 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e7742542-fa64-42a9-b99e-6202a6705c08 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.259596 Jun 16 19:46:10.216926 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 189/375] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:09 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:10.281860 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8c296513-95e0-4d9b-8248-1a59522a5db0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:10.282681 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8c296513-95e0-4d9b-8248-1a59522a5db0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:10.341371 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8c296513-95e0-4d9b-8248-1a59522a5db0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:10.348265 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8c296513-95e0-4d9b-8248-1a59522a5db0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1246 microversion: 2.1 time: 0.071832 Jun 16 19:46:10.348823 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 187/376] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:10 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:10.769989 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4fa3887e-fba1-490e-892e-bbaf57f21bd6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:10.770509 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4fa3887e-fba1-490e-892e-bbaf57f21bd6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:10.777532 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4fa3887e-fba1-490e-892e-bbaf57f21bd6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:10.777954 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4fa3887e-fba1-490e-892e-bbaf57f21bd6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:10.778792 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4fa3887e-fba1-490e-892e-bbaf57f21bd6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:10.779260 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4fa3887e-fba1-490e-892e-bbaf57f21bd6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:10.934120 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4fa3887e-fba1-490e-892e-bbaf57f21bd6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:10.945758 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-996fdb38-1f15-43fe-9798-3fd93e256f19 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:10.946471 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-996fdb38-1f15-43fe-9798-3fd93e256f19 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:10.951326 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4fa3887e-fba1-490e-892e-bbaf57f21bd6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1367 microversion: 2.1 time: 0.185216 Jun 16 19:46:10.951915 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 190/377] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:10 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:10.956053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-996fdb38-1f15-43fe-9798-3fd93e256f19 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:10.956565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-996fdb38-1f15-43fe-9798-3fd93e256f19 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:10.957405 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-996fdb38-1f15-43fe-9798-3fd93e256f19 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:10.959153 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-996fdb38-1f15-43fe-9798-3fd93e256f19 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:10.996359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-996fdb38-1f15-43fe-9798-3fd93e256f19 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:10.996807 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-996fdb38-1f15-43fe-9798-3fd93e256f19 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:10.997573 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-996fdb38-1f15-43fe-9798-3fd93e256f19 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lazy-loading 'fault' on Instance uuid 5d8add5e-2cff-4707-b035-9db6bfdf812c {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:46:11.037684 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-996fdb38-1f15-43fe-9798-3fd93e256f19 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:11.046407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-996fdb38-1f15-43fe-9798-3fd93e256f19 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 200 len: 1303 microversion: 2.1 time: 0.105417 Jun 16 19:46:11.047073 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 188/378] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:10 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:11.236288 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-25c34479-d085-40a0-98ba-c42f4489b6cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:11.237566 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-25c34479-d085-40a0-98ba-c42f4489b6cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:11.243913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-25c34479-d085-40a0-98ba-c42f4489b6cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:11.244361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-25c34479-d085-40a0-98ba-c42f4489b6cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:11.245113 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-25c34479-d085-40a0-98ba-c42f4489b6cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:11.245691 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-25c34479-d085-40a0-98ba-c42f4489b6cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:11.365559 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9380d532-f8ca-4e50-ad09-07210458626d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:11.366683 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9380d532-f8ca-4e50-ad09-07210458626d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:11.375490 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9380d532-f8ca-4e50-ad09-07210458626d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:11.375948 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9380d532-f8ca-4e50-ad09-07210458626d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:11.376754 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9380d532-f8ca-4e50-ad09-07210458626d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:11.378873 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9380d532-f8ca-4e50-ad09-07210458626d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:11.431797 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-25c34479-d085-40a0-98ba-c42f4489b6cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:11.442313 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-25c34479-d085-40a0-98ba-c42f4489b6cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:11.444977 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-25c34479-d085-40a0-98ba-c42f4489b6cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:11.448248 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-25c34479-d085-40a0-98ba-c42f4489b6cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.218338 Jun 16 19:46:11.449436 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 191/379] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:11 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:11.500177 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9380d532-f8ca-4e50-ad09-07210458626d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:11.508437 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9380d532-f8ca-4e50-ad09-07210458626d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1242 microversion: 2.1 time: 0.147139 Jun 16 19:46:11.515191 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 189/380] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:11 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1242 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:11.785069 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-e05269c3-3c1b-45b0-8638-ab1e56ace91d req-5557ee09-27a0-408b-8b83-65f828710946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb16dee5-a334-4d62-8b28-cd5a9632b6cc", "name": "network-vif-plugged", "status": "completed", "tag": "b303c9b9-b850-4aed-b10c-081efef3620f"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:11.793045 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-e05269c3-3c1b-45b0-8638-ab1e56ace91d req-5557ee09-27a0-408b-8b83-65f828710946 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:11.793482 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-e05269c3-3c1b-45b0-8638-ab1e56ace91d req-5557ee09-27a0-408b-8b83-65f828710946 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:11.804315 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-e05269c3-3c1b-45b0-8638-ab1e56ace91d req-5557ee09-27a0-408b-8b83-65f828710946 service nova] Creating event network-vif-plugged:b303c9b9-b850-4aed-b10c-081efef3620f for instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc on hv-cinder-84617 Jun 16 19:46:11.809091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-e05269c3-3c1b-45b0-8638-ab1e56ace91d req-5557ee09-27a0-408b-8b83-65f828710946 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027667 Jun 16 19:46:11.810165 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 192/381] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:46:11.972067 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9161226a-ed0a-419c-ad76-d4062a0cb191 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:11.973440 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9161226a-ed0a-419c-ad76-d4062a0cb191 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:11.988914 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9161226a-ed0a-419c-ad76-d4062a0cb191 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:11.989495 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9161226a-ed0a-419c-ad76-d4062a0cb191 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:11.990635 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9161226a-ed0a-419c-ad76-d4062a0cb191 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:11.991344 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9161226a-ed0a-419c-ad76-d4062a0cb191 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:12.064883 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bb004f93-a0ad-4591-bcfa-2689d476afca tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:12.065782 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-bb004f93-a0ad-4591-bcfa-2689d476afca tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 5d8add5e-2cff-4707-b035-9db6bfdf812c] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:12.073571 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bb004f93-a0ad-4591-bcfa-2689d476afca tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:12.074001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bb004f93-a0ad-4591-bcfa-2689d476afca tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:12.079236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bb004f93-a0ad-4591-bcfa-2689d476afca tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:12.080009 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bb004f93-a0ad-4591-bcfa-2689d476afca tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:12.096455 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-bb004f93-a0ad-4591-bcfa-2689d476afca tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] HTTP exception thrown: Instance 5d8add5e-2cff-4707-b035-9db6bfdf812c could not be found. Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bb004f93-a0ad-4591-bcfa-2689d476afca tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Request method failure captured: Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c HTTP/1.1 Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4hmflkD_UcKhzR8swqxrHy0y-OQymB8pA7TyhRBXRuljLsUzEIV_z7EHlCz7Ak7L3K1ypaiWoJ-ciXZgikt3qL2pd6XRPJ5TnGvo0vZ1LzaABK1CSK-C49Sr5leg9HfIJSR9hPf6y6Z8OZx2jH3bslDQlvvdsWwkug2ODCERgFDSlI Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 7ca93a40aa85448a8e5165f4c268678a Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesActionsTest-440765112 Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:46:12.098720 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:46:12.100165 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7ca93a40aa85448a8e5165f4c268678a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7ca93a40aa85448a8e5165f4c268678a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7ca93a40aa85448a8e5165f4c268678a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7ca93a40aa85448a8e5165f4c268678a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:46:12.100165 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesActionsTest-440765112 Jun 16 19:46:12.100165 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 7ca93a40aa85448a8e5165f4c268678a Jun 16 19:46:12.100165 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesActionsTest-440765112 Jun 16 19:46:12.100165 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesActionsTest-440765112-project Jun 16 19:46:12.100165 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:46:12.100165 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:46:12.100165 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 61d74fdb719b40208ee408b838256a0f Jun 16 19:46:12.100165 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesActionsTest-440765112-project Jun 16 19:46:12.100165 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:46:12.100165 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance 5d8add5e-2cff-4707-b035-9db6bfdf812c could not be found. Jun 16 19:46:12.100165 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': '5d8add5e-2cff-4707-b035-9db6bfdf812c'} Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d8add5e-2cff-4707-b035-9db6bfdf812c could not be found. Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:46:12.100913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:46:12.102146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:46:12.102146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:46:12.102146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:46:12.102146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:46:12.102146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:46:12.102146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:46:12.102146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:46:12.102146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d8add5e-2cff-4707-b035-9db6bfdf812c could not be found. Jun 16 19:46:12.102146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:46:12.102146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:46:12.102146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:46:12.102146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:46:12.102146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:46:12.102146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:46:12.102146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:46:12.102146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:46:12.102146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d8add5e-2cff-4707-b035-9db6bfdf812c could not be found. Jun 16 19:46:12.102146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:46:12.106706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bb004f93-a0ad-4591-bcfa-2689d476afca tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Returning 404 to user: Instance 5d8add5e-2cff-4707-b035-9db6bfdf812c could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:46:12.107631 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-bb004f93-a0ad-4591-bcfa-2689d476afca tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c" status: 404 len: 111 microversion: 2.1 time: 0.047711 Jun 16 19:46:12.109741 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 193/382] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:12 2022] GET /compute/v2.1/servers/5d8add5e-2cff-4707-b035-9db6bfdf812c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:46:12.288990 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-381f692d-632e-47e7-bcce-5c45b8d9ebb0 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1865346985", "imageRef": "9fcb2be6-02db-4853-a8d6-6478a75f26a3", "flavorRef": "452", "networks": [{"uuid": "9211c9f6-79c8-45ba-a53f-4f8f2e900b07"}]}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:12.394978 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9161226a-ed0a-419c-ad76-d4062a0cb191 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:12.416019 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-381f692d-632e-47e7-bcce-5c45b8d9ebb0 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] validate_networks() for [('9211c9f6-79c8-45ba-a53f-4f8f2e900b07', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:46:12.422433 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9161226a-ed0a-419c-ad76-d4062a0cb191 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1367 microversion: 2.1 time: 0.454258 Jun 16 19:46:12.431004 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 190/383] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:11 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1367 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:12.469092 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-128c5d26-e57e-4da3-8972-073340c233e5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:12.469977 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-128c5d26-e57e-4da3-8972-073340c233e5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:12.501594 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-128c5d26-e57e-4da3-8972-073340c233e5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:12.502501 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-128c5d26-e57e-4da3-8972-073340c233e5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:12.507230 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-128c5d26-e57e-4da3-8972-073340c233e5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:12.507969 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-128c5d26-e57e-4da3-8972-073340c233e5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:12.830723 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-128c5d26-e57e-4da3-8972-073340c233e5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:12.850617 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-128c5d26-e57e-4da3-8972-073340c233e5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:12.853149 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-128c5d26-e57e-4da3-8972-073340c233e5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:12.860585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-128c5d26-e57e-4da3-8972-073340c233e5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.391394 Jun 16 19:46:12.873201 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 191/384] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:12 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:12.893834 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b314e415-dc9f-4907-a0c4-7689b456d860 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:12.894744 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b314e415-dc9f-4907-a0c4-7689b456d860 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:12.922252 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b314e415-dc9f-4907-a0c4-7689b456d860 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:12.922252 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b314e415-dc9f-4907-a0c4-7689b456d860 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:12.922252 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b314e415-dc9f-4907-a0c4-7689b456d860 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:12.922252 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b314e415-dc9f-4907-a0c4-7689b456d860 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:12.970424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:12.992124 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-381f692d-632e-47e7-bcce-5c45b8d9ebb0 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:46:12.992609 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-381f692d-632e-47e7-bcce-5c45b8d9ebb0 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:46:12.993993 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-381f692d-632e-47e7-bcce-5c45b8d9ebb0 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:46:12.994451 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-381f692d-632e-47e7-bcce-5c45b8d9ebb0 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:46:12.995036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-381f692d-632e-47e7-bcce-5c45b8d9ebb0 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:46:13.024620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-381f692d-632e-47e7-bcce-5c45b8d9ebb0 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:13.028178 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-381f692d-632e-47e7-bcce-5c45b8d9ebb0 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:13.030092 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-381f692d-632e-47e7-bcce-5c45b8d9ebb0 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:13.030968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-381f692d-632e-47e7-bcce-5c45b8d9ebb0 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:13.059184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b314e415-dc9f-4907-a0c4-7689b456d860 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:13.075076 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b314e415-dc9f-4907-a0c4-7689b456d860 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1306 microversion: 2.1 time: 0.196784 Jun 16 19:46:13.076247 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 192/385] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:12 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1306 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:13.079717 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-381f692d-632e-47e7-bcce-5c45b8d9ebb0 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Getting quotas for project 7ca93a40aa85448a8e5165f4c268678a. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:46:13.084560 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-381f692d-632e-47e7-bcce-5c45b8d9ebb0 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Getting quotas for user 61d74fdb719b40208ee408b838256a0f and project 7ca93a40aa85448a8e5165f4c268678a. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:46:13.097138 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-381f692d-632e-47e7-bcce-5c45b8d9ebb0 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:46:13.113135 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-381f692d-632e-47e7-bcce-5c45b8d9ebb0 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcb2be6-02db-4853-a8d6-6478a75f26a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:46:13.306741 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-381f692d-632e-47e7-bcce-5c45b8d9ebb0 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.021476 Jun 16 19:46:13.341980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-42b86fa5-39f7-4624-9dfd-583dafb0edcc tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:13.341980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-42b86fa5-39f7-4624-9dfd-583dafb0edcc tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:13.342146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 194/386] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:46:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:46:13.439552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9932a3d3-ee9e-40e0-94a1-0498a8b5ee9e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:13.440695 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9932a3d3-ee9e-40e0-94a1-0498a8b5ee9e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:13.448242 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9932a3d3-ee9e-40e0-94a1-0498a8b5ee9e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:13.448948 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9932a3d3-ee9e-40e0-94a1-0498a8b5ee9e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:13.466866 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9932a3d3-ee9e-40e0-94a1-0498a8b5ee9e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:13.467711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9932a3d3-ee9e-40e0-94a1-0498a8b5ee9e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:13.484957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-42b86fa5-39f7-4624-9dfd-583dafb0edcc tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:13.506517 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-42b86fa5-39f7-4624-9dfd-583dafb0edcc tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1214 microversion: 2.1 time: 0.183828 Jun 16 19:46:13.516283 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 193/387] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:13 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1214 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:13.690284 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9932a3d3-ee9e-40e0-94a1-0498a8b5ee9e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:13.699411 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9932a3d3-ee9e-40e0-94a1-0498a8b5ee9e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1367 microversion: 2.1 time: 0.264837 Jun 16 19:46:13.700522 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 195/388] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:13 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:13.893520 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6132e56c-6683-46b7-a9ea-2c355ef235a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:13.895466 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6132e56c-6683-46b7-a9ea-2c355ef235a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:13.909187 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6132e56c-6683-46b7-a9ea-2c355ef235a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:13.909641 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6132e56c-6683-46b7-a9ea-2c355ef235a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:13.910435 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6132e56c-6683-46b7-a9ea-2c355ef235a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:13.910874 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6132e56c-6683-46b7-a9ea-2c355ef235a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:14.095349 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e7b999c3-8548-4151-8194-1d606408441b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:14.096282 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e7b999c3-8548-4151-8194-1d606408441b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:14.113765 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e7b999c3-8548-4151-8194-1d606408441b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:14.114390 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e7b999c3-8548-4151-8194-1d606408441b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:14.115372 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e7b999c3-8548-4151-8194-1d606408441b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:14.115838 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e7b999c3-8548-4151-8194-1d606408441b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:14.178656 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6132e56c-6683-46b7-a9ea-2c355ef235a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:14.190561 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6132e56c-6683-46b7-a9ea-2c355ef235a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:14.196217 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6132e56c-6683-46b7-a9ea-2c355ef235a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:14.200677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6132e56c-6683-46b7-a9ea-2c355ef235a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.324075 Jun 16 19:46:14.203851 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 194/389] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:13 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:14.247111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e7b999c3-8548-4151-8194-1d606408441b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:14.269410 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e7b999c3-8548-4151-8194-1d606408441b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1304 microversion: 2.1 time: 0.180519 Jun 16 19:46:14.270206 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 196/390] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:14 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1304 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:14.522199 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1f378178-b457-4f69-b066-b55797a2303e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:14.522820 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-1f378178-b457-4f69-b066-b55797a2303e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:14.600347 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1f378178-b457-4f69-b066-b55797a2303e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:14.610301 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-1f378178-b457-4f69-b066-b55797a2303e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1214 microversion: 2.1 time: 0.091760 Jun 16 19:46:14.625909 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 195/391] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:14 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:14.720174 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-96556e66-86eb-4376-b258-fb7cefe289f1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:14.721057 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-96556e66-86eb-4376-b258-fb7cefe289f1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:14.731128 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-96556e66-86eb-4376-b258-fb7cefe289f1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:14.731582 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-96556e66-86eb-4376-b258-fb7cefe289f1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:14.732350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-96556e66-86eb-4376-b258-fb7cefe289f1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:14.732777 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-96556e66-86eb-4376-b258-fb7cefe289f1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:14.889294 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-96556e66-86eb-4376-b258-fb7cefe289f1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:14.896703 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-96556e66-86eb-4376-b258-fb7cefe289f1 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1558 microversion: 2.1 time: 0.185181 Jun 16 19:46:14.897259 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 197/392] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:14 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:14.917285 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-155034b4-407f-4dd3-b595-f9b470dcc0d7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:14.917285 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-155034b4-407f-4dd3-b595-f9b470dcc0d7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:14.921645 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-155034b4-407f-4dd3-b595-f9b470dcc0d7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:14.922168 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-155034b4-407f-4dd3-b595-f9b470dcc0d7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:14.923007 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-155034b4-407f-4dd3-b595-f9b470dcc0d7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:14.923662 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-155034b4-407f-4dd3-b595-f9b470dcc0d7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:15.074733 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-155034b4-407f-4dd3-b595-f9b470dcc0d7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.164889 Jun 16 19:46:15.089876 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 196/393] 10.222.0.36 () {58 vars in 1274 bytes} [Thu Jun 16 19:46:14 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc/os-interface => generated 285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:46:15.219754 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d835647e-45c3-4a08-8ce7-ea74140a2bc7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:15.220506 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d835647e-45c3-4a08-8ce7-ea74140a2bc7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:15.227338 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d835647e-45c3-4a08-8ce7-ea74140a2bc7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:15.228020 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d835647e-45c3-4a08-8ce7-ea74140a2bc7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:15.229042 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d835647e-45c3-4a08-8ce7-ea74140a2bc7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:15.229672 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d835647e-45c3-4a08-8ce7-ea74140a2bc7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:15.304722 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-23ffd304-beb5-45f1-9b4d-70082cfe47bc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:15.305511 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-23ffd304-beb5-45f1-9b4d-70082cfe47bc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:15.313678 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-23ffd304-beb5-45f1-9b4d-70082cfe47bc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:15.313678 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-23ffd304-beb5-45f1-9b4d-70082cfe47bc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:15.317888 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-23ffd304-beb5-45f1-9b4d-70082cfe47bc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:15.320266 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-23ffd304-beb5-45f1-9b4d-70082cfe47bc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:15.417695 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d835647e-45c3-4a08-8ce7-ea74140a2bc7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:15.427266 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d835647e-45c3-4a08-8ce7-ea74140a2bc7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:15.428798 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d835647e-45c3-4a08-8ce7-ea74140a2bc7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:15.430169 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d835647e-45c3-4a08-8ce7-ea74140a2bc7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.215195 Jun 16 19:46:15.430875 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 198/394] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:15 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:15.692331 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-78573f07-5356-4e9e-b8a0-456823859d36 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:15.693761 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-78573f07-5356-4e9e-b8a0-456823859d36 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:15.720297 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-23ffd304-beb5-45f1-9b4d-70082cfe47bc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:15.730755 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-23ffd304-beb5-45f1-9b4d-70082cfe47bc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1304 microversion: 2.1 time: 0.430849 Jun 16 19:46:15.732941 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-78573f07-5356-4e9e-b8a0-456823859d36 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:15.733459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-78573f07-5356-4e9e-b8a0-456823859d36 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:15.735265 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 197/395] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:15 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1304 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:15.745518 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-78573f07-5356-4e9e-b8a0-456823859d36 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:15.746247 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-78573f07-5356-4e9e-b8a0-456823859d36 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:15.772237 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:15.884453 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-78573f07-5356-4e9e-b8a0-456823859d36 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:15.893061 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-78573f07-5356-4e9e-b8a0-456823859d36 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1210 microversion: 2.1 time: 0.216681 Jun 16 19:46:15.902888 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 199/396] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:15 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1210 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:16.449089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-177fad4a-f319-40c9-b26e-823f98cb676e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:16.451138 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-177fad4a-f319-40c9-b26e-823f98cb676e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:16.460540 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-177fad4a-f319-40c9-b26e-823f98cb676e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:16.461274 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-177fad4a-f319-40c9-b26e-823f98cb676e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:16.468177 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-177fad4a-f319-40c9-b26e-823f98cb676e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:16.468177 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-177fad4a-f319-40c9-b26e-823f98cb676e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:16.757623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d3830cba-c14a-477d-b6c7-a8225c7412bd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:16.762874 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d3830cba-c14a-477d-b6c7-a8225c7412bd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:16.783933 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d3830cba-c14a-477d-b6c7-a8225c7412bd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:16.791468 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d3830cba-c14a-477d-b6c7-a8225c7412bd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:16.799931 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d3830cba-c14a-477d-b6c7-a8225c7412bd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:16.800915 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d3830cba-c14a-477d-b6c7-a8225c7412bd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:16.817607 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-177fad4a-f319-40c9-b26e-823f98cb676e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:16.831636 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-177fad4a-f319-40c9-b26e-823f98cb676e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:16.835736 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-177fad4a-f319-40c9-b26e-823f98cb676e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:16.836931 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-177fad4a-f319-40c9-b26e-823f98cb676e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.392538 Jun 16 19:46:16.869517 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 198/397] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:16 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:16.922420 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c0331551-9cb2-4eeb-8dd7-98c1fa053988 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:16.923087 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c0331551-9cb2-4eeb-8dd7-98c1fa053988 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:16.931081 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c0331551-9cb2-4eeb-8dd7-98c1fa053988 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:16.934829 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c0331551-9cb2-4eeb-8dd7-98c1fa053988 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:16.936012 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c0331551-9cb2-4eeb-8dd7-98c1fa053988 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:16.936779 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c0331551-9cb2-4eeb-8dd7-98c1fa053988 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:17.073894 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d3830cba-c14a-477d-b6c7-a8225c7412bd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:17.082104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d3830cba-c14a-477d-b6c7-a8225c7412bd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1371 microversion: 2.1 time: 0.329320 Jun 16 19:46:17.083292 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 200/398] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:16 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1371 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:17.100042 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c0331551-9cb2-4eeb-8dd7-98c1fa053988 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:17.115251 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c0331551-9cb2-4eeb-8dd7-98c1fa053988 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1266 microversion: 2.1 time: 0.198880 Jun 16 19:46:17.121330 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 199/399] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:16 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:17.856787 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ec67afaa-5504-4e8c-aa9b-ad300d3f2068 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:17.857405 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ec67afaa-5504-4e8c-aa9b-ad300d3f2068 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:17.881476 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-baefb101-f31e-4046-990c-a6b53e0bd97d req-2bbc5a66-2a99-4009-902f-4ef84694790f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb16dee5-a334-4d62-8b28-cd5a9632b6cc", "tag": "b303c9b9-b850-4aed-b10c-081efef3620f"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:17.886272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec67afaa-5504-4e8c-aa9b-ad300d3f2068 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:17.886968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec67afaa-5504-4e8c-aa9b-ad300d3f2068 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:17.888009 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec67afaa-5504-4e8c-aa9b-ad300d3f2068 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:17.888845 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec67afaa-5504-4e8c-aa9b-ad300d3f2068 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:17.919341 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-baefb101-f31e-4046-990c-a6b53e0bd97d req-2bbc5a66-2a99-4009-902f-4ef84694790f service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:17.919806 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-baefb101-f31e-4046-990c-a6b53e0bd97d req-2bbc5a66-2a99-4009-902f-4ef84694790f service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:17.980618 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-baefb101-f31e-4046-990c-a6b53e0bd97d req-2bbc5a66-2a99-4009-902f-4ef84694790f service nova] Creating event network-changed:b303c9b9-b850-4aed-b10c-081efef3620f for instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc on hv-cinder-84617 Jun 16 19:46:18.024111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-baefb101-f31e-4046-990c-a6b53e0bd97d req-2bbc5a66-2a99-4009-902f-4ef84694790f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146224 Jun 16 19:46:18.025244 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 200/400] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:46:18.102141 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-90141ed3-d4da-4203-9ed3-ead2eca7252b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:18.103045 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-90141ed3-d4da-4203-9ed3-ead2eca7252b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:18.110839 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-90141ed3-d4da-4203-9ed3-ead2eca7252b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:18.112384 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-90141ed3-d4da-4203-9ed3-ead2eca7252b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:18.114174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-90141ed3-d4da-4203-9ed3-ead2eca7252b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:18.114764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-90141ed3-d4da-4203-9ed3-ead2eca7252b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:18.422545 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-90141ed3-d4da-4203-9ed3-ead2eca7252b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:18.432944 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-90141ed3-d4da-4203-9ed3-ead2eca7252b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1371 microversion: 2.1 time: 0.335481 Jun 16 19:46:18.434739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 201/401] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:18 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1371 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:18.444781 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-fa41f252-7c6a-42a7-a55d-27b06a8918a9 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:18.457267 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-fa41f252-7c6a-42a7-a55d-27b06a8918a9 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:18.467947 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fa41f252-7c6a-42a7-a55d-27b06a8918a9 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:18.468405 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fa41f252-7c6a-42a7-a55d-27b06a8918a9 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:18.472072 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fa41f252-7c6a-42a7-a55d-27b06a8918a9 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:18.472573 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fa41f252-7c6a-42a7-a55d-27b06a8918a9 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:18.558786 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-fa41f252-7c6a-42a7-a55d-27b06a8918a9 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:18.568344 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-fa41f252-7c6a-42a7-a55d-27b06a8918a9 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1272 microversion: 2.1 time: 0.132333 Jun 16 19:46:18.569772 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 202/402] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:18 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:18.830888 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ec67afaa-5504-4e8c-aa9b-ad300d3f2068 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:18.846870 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ec67afaa-5504-4e8c-aa9b-ad300d3f2068 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:18.848585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ec67afaa-5504-4e8c-aa9b-ad300d3f2068 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:18.856268 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ec67afaa-5504-4e8c-aa9b-ad300d3f2068 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 1.002729 Jun 16 19:46:18.856268 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 201/403] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:17 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:19.569526 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6d0b71ed-bdc8-4296-8cbb-16eabce1f722 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:19.569526 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6d0b71ed-bdc8-4296-8cbb-16eabce1f722 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:19.569526 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6d0b71ed-bdc8-4296-8cbb-16eabce1f722 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:19.569526 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6d0b71ed-bdc8-4296-8cbb-16eabce1f722 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:19.572385 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6d0b71ed-bdc8-4296-8cbb-16eabce1f722 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:19.572385 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6d0b71ed-bdc8-4296-8cbb-16eabce1f722 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:19.586135 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ec78f4e6-c47e-41db-b692-d1291545370e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:19.586913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ec78f4e6-c47e-41db-b692-d1291545370e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:19.622292 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec78f4e6-c47e-41db-b692-d1291545370e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:19.622292 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec78f4e6-c47e-41db-b692-d1291545370e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:19.622292 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec78f4e6-c47e-41db-b692-d1291545370e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:19.622292 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec78f4e6-c47e-41db-b692-d1291545370e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:19.631488 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6d0b71ed-bdc8-4296-8cbb-16eabce1f722 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:19.640822 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6d0b71ed-bdc8-4296-8cbb-16eabce1f722 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1371 microversion: 2.1 time: 0.194584 Jun 16 19:46:19.642045 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 203/404] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:19 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:19.738563 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ec78f4e6-c47e-41db-b692-d1291545370e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:19.768127 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ec78f4e6-c47e-41db-b692-d1291545370e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1272 microversion: 2.1 time: 0.186263 Jun 16 19:46:19.771121 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 202/405] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:19 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1272 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:19.872482 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d9bf4860-450a-4716-a8a1-dc3a4a8643f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:19.873363 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d9bf4860-450a-4716-a8a1-dc3a4a8643f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:19.880047 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d9bf4860-450a-4716-a8a1-dc3a4a8643f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:19.880701 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d9bf4860-450a-4716-a8a1-dc3a4a8643f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:19.881651 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d9bf4860-450a-4716-a8a1-dc3a4a8643f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:19.882267 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d9bf4860-450a-4716-a8a1-dc3a4a8643f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:20.068284 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d9bf4860-450a-4716-a8a1-dc3a4a8643f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:20.086415 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d9bf4860-450a-4716-a8a1-dc3a4a8643f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:20.104375 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d9bf4860-450a-4716-a8a1-dc3a4a8643f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:20.106069 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d9bf4860-450a-4716-a8a1-dc3a4a8643f8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.237192 Jun 16 19:46:20.107844 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 204/406] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:19 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:20.117923 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-112a3bcf-412d-4f2c-9859-a75ffae73dde req-36a86a73-f4d5-4646-85b6-be2d58263759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea242cf7-0535-4532-aaa0-59848bf41c73", "tag": "521225d6-b4cf-4644-b00e-7e1640cf92c7"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:20.122899 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-112a3bcf-412d-4f2c-9859-a75ffae73dde req-36a86a73-f4d5-4646-85b6-be2d58263759 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:20.123956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-112a3bcf-412d-4f2c-9859-a75ffae73dde req-36a86a73-f4d5-4646-85b6-be2d58263759 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:20.136176 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-112a3bcf-412d-4f2c-9859-a75ffae73dde req-36a86a73-f4d5-4646-85b6-be2d58263759 service nova] Creating event network-changed:521225d6-b4cf-4644-b00e-7e1640cf92c7 for instance ea242cf7-0535-4532-aaa0-59848bf41c73 on hv-cinder-84617 Jun 16 19:46:20.149059 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-112a3bcf-412d-4f2c-9859-a75ffae73dde req-36a86a73-f4d5-4646-85b6-be2d58263759 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036109 Jun 16 19:46:20.151294 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 203/407] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:46:20.659107 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-ffb7adbd-2540-467b-9b58-ec5dda682633 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:20.660469 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-ffb7adbd-2540-467b-9b58-ec5dda682633 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:20.683065 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ffb7adbd-2540-467b-9b58-ec5dda682633 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:20.688067 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ffb7adbd-2540-467b-9b58-ec5dda682633 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:20.688067 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ffb7adbd-2540-467b-9b58-ec5dda682633 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:20.688067 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ffb7adbd-2540-467b-9b58-ec5dda682633 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:20.787542 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-add5835f-cc83-4eb9-90eb-0fcbb593865f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:20.789141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-add5835f-cc83-4eb9-90eb-0fcbb593865f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:20.797024 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-add5835f-cc83-4eb9-90eb-0fcbb593865f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:20.797466 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-add5835f-cc83-4eb9-90eb-0fcbb593865f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:20.798684 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-add5835f-cc83-4eb9-90eb-0fcbb593865f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:20.799389 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-add5835f-cc83-4eb9-90eb-0fcbb593865f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:20.845321 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ffb7adbd-2540-467b-9b58-ec5dda682633 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:20.861371 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-ffb7adbd-2540-467b-9b58-ec5dda682633 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1371 microversion: 2.1 time: 0.205197 Jun 16 19:46:20.861371 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 205/408] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:20 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:20.956277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-add5835f-cc83-4eb9-90eb-0fcbb593865f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:20.964435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-add5835f-cc83-4eb9-90eb-0fcbb593865f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1314 microversion: 2.1 time: 0.181072 Jun 16 19:46:20.966027 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 204/409] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:20 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:21.127555 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6b02ee0e-4edd-45fa-8e5b-f8a2306b47bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:21.129513 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6b02ee0e-4edd-45fa-8e5b-f8a2306b47bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:21.136591 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6b02ee0e-4edd-45fa-8e5b-f8a2306b47bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:21.137303 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6b02ee0e-4edd-45fa-8e5b-f8a2306b47bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:21.138503 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6b02ee0e-4edd-45fa-8e5b-f8a2306b47bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:21.139349 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6b02ee0e-4edd-45fa-8e5b-f8a2306b47bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:21.383738 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6b02ee0e-4edd-45fa-8e5b-f8a2306b47bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:21.423325 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6b02ee0e-4edd-45fa-8e5b-f8a2306b47bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:21.425731 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6b02ee0e-4edd-45fa-8e5b-f8a2306b47bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:21.427286 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6b02ee0e-4edd-45fa-8e5b-f8a2306b47bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.305619 Jun 16 19:46:21.428570 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 206/410] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:21 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:21.876989 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-13789dfb-ab67-40bc-90cf-f61ea97b4c7a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:21.877661 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-13789dfb-ab67-40bc-90cf-f61ea97b4c7a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:21.889491 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-13789dfb-ab67-40bc-90cf-f61ea97b4c7a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:21.892837 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-13789dfb-ab67-40bc-90cf-f61ea97b4c7a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:21.896560 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-13789dfb-ab67-40bc-90cf-f61ea97b4c7a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:21.897223 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-13789dfb-ab67-40bc-90cf-f61ea97b4c7a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:21.996263 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-97ee568a-015b-4381-ab07-89b20c1fa019 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:22.003271 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-97ee568a-015b-4381-ab07-89b20c1fa019 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:22.015826 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-97ee568a-015b-4381-ab07-89b20c1fa019 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:22.016272 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-97ee568a-015b-4381-ab07-89b20c1fa019 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:22.017281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-97ee568a-015b-4381-ab07-89b20c1fa019 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:22.018098 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-97ee568a-015b-4381-ab07-89b20c1fa019 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:22.249668 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-13789dfb-ab67-40bc-90cf-f61ea97b4c7a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:22.258539 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-13789dfb-ab67-40bc-90cf-f61ea97b4c7a tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1371 microversion: 2.1 time: 0.385511 Jun 16 19:46:22.269064 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 205/411] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:21 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1371 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:22.413114 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-97ee568a-015b-4381-ab07-89b20c1fa019 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:22.423553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-97ee568a-015b-4381-ab07-89b20c1fa019 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1314 microversion: 2.1 time: 0.436723 Jun 16 19:46:22.429174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 207/412] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:21 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:22.446493 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b6b3b2cd-bde5-42a4-a111-9f9af6d3e1e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:22.447127 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b6b3b2cd-bde5-42a4-a111-9f9af6d3e1e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:22.468880 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b6b3b2cd-bde5-42a4-a111-9f9af6d3e1e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:22.472054 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b6b3b2cd-bde5-42a4-a111-9f9af6d3e1e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:22.473285 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b6b3b2cd-bde5-42a4-a111-9f9af6d3e1e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:22.474655 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b6b3b2cd-bde5-42a4-a111-9f9af6d3e1e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:22.647484 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-03eaf36d-9dea-4d3c-9147-dbc49060f953 req-12a47260-680b-40d4-b648-db2e030ada6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3abc0598-490a-4217-9fad-bb38f5fa15c7", "tag": "a8bc1f61-9f0d-4829-a38f-8059afd21d69"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:22.660281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-03eaf36d-9dea-4d3c-9147-dbc49060f953 req-12a47260-680b-40d4-b648-db2e030ada6e service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:22.660890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-03eaf36d-9dea-4d3c-9147-dbc49060f953 req-12a47260-680b-40d4-b648-db2e030ada6e service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:22.704352 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-03eaf36d-9dea-4d3c-9147-dbc49060f953 req-12a47260-680b-40d4-b648-db2e030ada6e service nova] Creating event network-changed:a8bc1f61-9f0d-4829-a38f-8059afd21d69 for instance 3abc0598-490a-4217-9fad-bb38f5fa15c7 on hv-cinder-84617 Jun 16 19:46:22.711316 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-03eaf36d-9dea-4d3c-9147-dbc49060f953 req-12a47260-680b-40d4-b648-db2e030ada6e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067148 Jun 16 19:46:22.711931 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 208/413] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:46:22.803924 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b6b3b2cd-bde5-42a4-a111-9f9af6d3e1e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:22.815404 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b6b3b2cd-bde5-42a4-a111-9f9af6d3e1e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:22.817668 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b6b3b2cd-bde5-42a4-a111-9f9af6d3e1e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:22.820287 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b6b3b2cd-bde5-42a4-a111-9f9af6d3e1e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1743 microversion: 2.20 time: 0.377489 Jun 16 19:46:22.821521 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 206/414] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:22 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1743 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:23.276768 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6c34405e-e8e6-4e4b-8acc-d6ae4e2f51b7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:23.277467 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6c34405e-e8e6-4e4b-8acc-d6ae4e2f51b7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:23.287870 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6c34405e-e8e6-4e4b-8acc-d6ae4e2f51b7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:23.288999 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6c34405e-e8e6-4e4b-8acc-d6ae4e2f51b7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:23.290071 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6c34405e-e8e6-4e4b-8acc-d6ae4e2f51b7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:23.290701 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6c34405e-e8e6-4e4b-8acc-d6ae4e2f51b7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:23.445009 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-77b6c400-cfbd-4223-a505-eb3934d36d77 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:23.446469 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-77b6c400-cfbd-4223-a505-eb3934d36d77 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:23.450270 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=4 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:23.454639 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=15 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:23.466047 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-77b6c400-cfbd-4223-a505-eb3934d36d77 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:23.473924 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-77b6c400-cfbd-4223-a505-eb3934d36d77 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:23.474763 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-77b6c400-cfbd-4223-a505-eb3934d36d77 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:23.475232 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-77b6c400-cfbd-4223-a505-eb3934d36d77 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:23.551996 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6c34405e-e8e6-4e4b-8acc-d6ae4e2f51b7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:23.561204 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6c34405e-e8e6-4e4b-8acc-d6ae4e2f51b7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1371 microversion: 2.1 time: 0.288933 Jun 16 19:46:23.562204 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 209/415] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:23 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:23.568713 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-2aefa36d-6790-4586-922c-6f13dd3f0213 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03ae856e-a299-48b9-a246-3f837a1349c9", "device": "/dev/sdb"}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:23.571375 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-2aefa36d-6790-4586-922c-6f13dd3f0213 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:23.578005 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2aefa36d-6790-4586-922c-6f13dd3f0213 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:23.578686 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2aefa36d-6790-4586-922c-6f13dd3f0213 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:23.579644 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2aefa36d-6790-4586-922c-6f13dd3f0213 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:23.580283 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2aefa36d-6790-4586-922c-6f13dd3f0213 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:23.839385 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-77b6c400-cfbd-4223-a505-eb3934d36d77 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:23.848640 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-77b6c400-cfbd-4223-a505-eb3934d36d77 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1314 microversion: 2.1 time: 0.408631 Jun 16 19:46:23.849234 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 207/416] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:23 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:23.864572 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0e597c92-eca4-4240-81ef-94450882ad0f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:23.865179 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0e597c92-eca4-4240-81ef-94450882ad0f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:23.871079 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e597c92-eca4-4240-81ef-94450882ad0f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:23.871566 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e597c92-eca4-4240-81ef-94450882ad0f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:23.872332 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e597c92-eca4-4240-81ef-94450882ad0f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:23.872764 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e597c92-eca4-4240-81ef-94450882ad0f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:24.213152 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0e597c92-eca4-4240-81ef-94450882ad0f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:24.234730 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0e597c92-eca4-4240-81ef-94450882ad0f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:24.234730 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0e597c92-eca4-4240-81ef-94450882ad0f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:24.234730 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0e597c92-eca4-4240-81ef-94450882ad0f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1743 microversion: 2.20 time: 0.366853 Jun 16 19:46:24.239052 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 208/417] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:23 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1743 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:24.583309 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e1ebe5d8-136e-4ca4-aac4-2570ca830787 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:24.583987 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e1ebe5d8-136e-4ca4-aac4-2570ca830787 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:24.586046 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:24.590803 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e1ebe5d8-136e-4ca4-aac4-2570ca830787 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:24.591675 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e1ebe5d8-136e-4ca4-aac4-2570ca830787 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:24.592080 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e1ebe5d8-136e-4ca4-aac4-2570ca830787 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:24.593189 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e1ebe5d8-136e-4ca4-aac4-2570ca830787 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:24.610536 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=8 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:24.880171 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e1ebe5d8-136e-4ca4-aac4-2570ca830787 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:24.890843 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e1ebe5d8-136e-4ca4-aac4-2570ca830787 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1371 microversion: 2.1 time: 0.311318 Jun 16 19:46:24.900694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 209/418] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:24 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1371 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:24.905778 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ae2ef1fa-e714-426b-822b-6816bdfc82eb tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:24.906378 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ae2ef1fa-e714-426b-822b-6816bdfc82eb tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:24.912411 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ae2ef1fa-e714-426b-822b-6816bdfc82eb tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:24.917993 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ae2ef1fa-e714-426b-822b-6816bdfc82eb tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:24.917993 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ae2ef1fa-e714-426b-822b-6816bdfc82eb tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:24.917993 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ae2ef1fa-e714-426b-822b-6816bdfc82eb tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:25.041022 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-2aefa36d-6790-4586-922c-6f13dd3f0213 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "POST /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.477418 Jun 16 19:46:25.041703 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 210/419] 10.222.0.36 () {60 vars in 1322 bytes} [Thu Jun 16 19:46:23 2022] POST /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1/os-volume_attachments => generated 194 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:46:25.128376 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ae2ef1fa-e714-426b-822b-6816bdfc82eb tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:25.135717 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ae2ef1fa-e714-426b-822b-6816bdfc82eb tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1314 microversion: 2.1 time: 0.233821 Jun 16 19:46:25.136276 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 210/420] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:24 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:25.247112 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-386f067c-ffcf-4180-ab6c-40dd8f9a7334 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:25.247807 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-386f067c-ffcf-4180-ab6c-40dd8f9a7334 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:25.253955 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-386f067c-ffcf-4180-ab6c-40dd8f9a7334 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:25.254434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-386f067c-ffcf-4180-ab6c-40dd8f9a7334 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:25.255219 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-386f067c-ffcf-4180-ab6c-40dd8f9a7334 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:25.255650 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-386f067c-ffcf-4180-ab6c-40dd8f9a7334 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:25.260353 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:25.428485 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-386f067c-ffcf-4180-ab6c-40dd8f9a7334 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:25.436585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-386f067c-ffcf-4180-ab6c-40dd8f9a7334 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:25.438100 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-386f067c-ffcf-4180-ab6c-40dd8f9a7334 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:25.439298 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-386f067c-ffcf-4180-ab6c-40dd8f9a7334 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1743 microversion: 2.20 time: 0.197005 Jun 16 19:46:25.440013 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 211/421] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:25 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1743 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:25.909830 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-746daf72-93ff-4000-b5ac-0af67c05e786 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:25.911381 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-746daf72-93ff-4000-b5ac-0af67c05e786 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:25.918114 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-746daf72-93ff-4000-b5ac-0af67c05e786 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:25.918589 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-746daf72-93ff-4000-b5ac-0af67c05e786 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:25.919661 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-746daf72-93ff-4000-b5ac-0af67c05e786 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:25.920194 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-746daf72-93ff-4000-b5ac-0af67c05e786 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:26.174750 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5d624589-4e21-443c-a8b7-3afaf3e35a8f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:26.193963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5d624589-4e21-443c-a8b7-3afaf3e35a8f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:26.203780 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d624589-4e21-443c-a8b7-3afaf3e35a8f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:26.204727 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d624589-4e21-443c-a8b7-3afaf3e35a8f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:26.206687 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d624589-4e21-443c-a8b7-3afaf3e35a8f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:26.207441 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d624589-4e21-443c-a8b7-3afaf3e35a8f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:26.390548 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5d624589-4e21-443c-a8b7-3afaf3e35a8f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:26.403005 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5d624589-4e21-443c-a8b7-3afaf3e35a8f tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1314 microversion: 2.1 time: 0.253621 Jun 16 19:46:26.408354 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 212/422] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:26 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:26.417595 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-5df5a2ea-c78c-4cc0-b6ee-07e017267524 req-7b857b56-2d60-48bb-99b9-25110a3ffb2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea242cf7-0535-4532-aaa0-59848bf41c73", "name": "network-vif-plugged", "status": "completed", "tag": "521225d6-b4cf-4644-b00e-7e1640cf92c7"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:26.426378 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-5df5a2ea-c78c-4cc0-b6ee-07e017267524 req-7b857b56-2d60-48bb-99b9-25110a3ffb2e service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:26.428069 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-5df5a2ea-c78c-4cc0-b6ee-07e017267524 req-7b857b56-2d60-48bb-99b9-25110a3ffb2e service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:26.438941 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-5df5a2ea-c78c-4cc0-b6ee-07e017267524 req-7b857b56-2d60-48bb-99b9-25110a3ffb2e service nova] Creating event network-vif-plugged:521225d6-b4cf-4644-b00e-7e1640cf92c7 for instance ea242cf7-0535-4532-aaa0-59848bf41c73 on hv-cinder-84617 Jun 16 19:46:26.444517 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-5df5a2ea-c78c-4cc0-b6ee-07e017267524 req-7b857b56-2d60-48bb-99b9-25110a3ffb2e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034546 Jun 16 19:46:26.445342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 213/423] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:46:26.460452 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3fa313d7-0422-4d6c-950d-5d71fef6a03b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:26.462023 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-3fa313d7-0422-4d6c-950d-5d71fef6a03b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:26.471855 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-746daf72-93ff-4000-b5ac-0af67c05e786 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:26.479931 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3fa313d7-0422-4d6c-950d-5d71fef6a03b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:26.493661 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3fa313d7-0422-4d6c-950d-5d71fef6a03b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:26.495415 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3fa313d7-0422-4d6c-950d-5d71fef6a03b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:26.495861 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3fa313d7-0422-4d6c-950d-5d71fef6a03b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:26.498729 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-746daf72-93ff-4000-b5ac-0af67c05e786 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1371 microversion: 2.1 time: 0.595421 Jun 16 19:46:26.499332 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 211/424] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:25 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1371 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:26.759523 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3fa313d7-0422-4d6c-950d-5d71fef6a03b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:26.794950 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3fa313d7-0422-4d6c-950d-5d71fef6a03b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:26.796581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3fa313d7-0422-4d6c-950d-5d71fef6a03b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:26.798178 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-3fa313d7-0422-4d6c-950d-5d71fef6a03b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1743 microversion: 2.20 time: 0.344010 Jun 16 19:46:26.801355 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 214/425] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:26 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1743 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:46:27.420654 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e4d5a2c0-7a98-4c09-b7c7-8d38a49cc00d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:27.422265 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e4d5a2c0-7a98-4c09-b7c7-8d38a49cc00d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:27.428983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e4d5a2c0-7a98-4c09-b7c7-8d38a49cc00d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:27.429514 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e4d5a2c0-7a98-4c09-b7c7-8d38a49cc00d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:27.430356 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e4d5a2c0-7a98-4c09-b7c7-8d38a49cc00d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:27.430897 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e4d5a2c0-7a98-4c09-b7c7-8d38a49cc00d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:27.517743 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9e033545-3ffd-4034-bf32-8a4a48374e6e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:27.519305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9e033545-3ffd-4034-bf32-8a4a48374e6e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:27.540614 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9e033545-3ffd-4034-bf32-8a4a48374e6e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:27.542224 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9e033545-3ffd-4034-bf32-8a4a48374e6e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:27.544040 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9e033545-3ffd-4034-bf32-8a4a48374e6e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:27.546155 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9e033545-3ffd-4034-bf32-8a4a48374e6e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:27.668950 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e4d5a2c0-7a98-4c09-b7c7-8d38a49cc00d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:27.679488 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e4d5a2c0-7a98-4c09-b7c7-8d38a49cc00d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1314 microversion: 2.1 time: 0.262842 Jun 16 19:46:27.680066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 212/426] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:27 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:27.786082 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9e033545-3ffd-4034-bf32-8a4a48374e6e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:27.795495 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9e033545-3ffd-4034-bf32-8a4a48374e6e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1371 microversion: 2.1 time: 0.282991 Jun 16 19:46:27.799712 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 215/427] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:27 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1371 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:27.817340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e696f15c-2464-4d52-92ed-c109a69464d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:27.818399 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e696f15c-2464-4d52-92ed-c109a69464d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:27.825077 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e696f15c-2464-4d52-92ed-c109a69464d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:27.828570 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e696f15c-2464-4d52-92ed-c109a69464d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:27.829543 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e696f15c-2464-4d52-92ed-c109a69464d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:27.832511 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e696f15c-2464-4d52-92ed-c109a69464d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:28.046005 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e696f15c-2464-4d52-92ed-c109a69464d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:28.055707 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e696f15c-2464-4d52-92ed-c109a69464d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:28.057458 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e696f15c-2464-4d52-92ed-c109a69464d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:28.058802 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e696f15c-2464-4d52-92ed-c109a69464d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1738 microversion: 2.20 time: 0.245434 Jun 16 19:46:28.059702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 213/428] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:27 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1738 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:28.467635 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-14897911-07fc-4e5d-84c1-0b77c5425d94 req-1ca028c4-1843-46b9-b20f-5c725e788a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f667dde1-232e-4f14-917f-0a749279d6a8", "name": "network-vif-plugged", "status": "completed", "tag": "ce7582ec-7186-425a-a407-f177022e1f52"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:28.477981 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-14897911-07fc-4e5d-84c1-0b77c5425d94 req-1ca028c4-1843-46b9-b20f-5c725e788a29 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:28.479042 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-14897911-07fc-4e5d-84c1-0b77c5425d94 req-1ca028c4-1843-46b9-b20f-5c725e788a29 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:28.506129 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-14897911-07fc-4e5d-84c1-0b77c5425d94 req-1ca028c4-1843-46b9-b20f-5c725e788a29 service nova] Creating event network-vif-plugged:ce7582ec-7186-425a-a407-f177022e1f52 for instance f667dde1-232e-4f14-917f-0a749279d6a8 on hv-cinder-84617 Jun 16 19:46:28.512306 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-14897911-07fc-4e5d-84c1-0b77c5425d94 req-1ca028c4-1843-46b9-b20f-5c725e788a29 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049744 Jun 16 19:46:28.513608 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 216/429] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:46:28.713362 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4a64065a-a5c7-4289-a402-e9a06bc9b906 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:28.716434 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4a64065a-a5c7-4289-a402-e9a06bc9b906 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:28.731804 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a64065a-a5c7-4289-a402-e9a06bc9b906 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:28.734238 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a64065a-a5c7-4289-a402-e9a06bc9b906 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:28.737101 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a64065a-a5c7-4289-a402-e9a06bc9b906 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:28.739847 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a64065a-a5c7-4289-a402-e9a06bc9b906 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:28.819841 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e95b8e44-b55d-42a7-b71f-f25bdb30605d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:28.822024 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e95b8e44-b55d-42a7-b71f-f25bdb30605d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:28.844539 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e95b8e44-b55d-42a7-b71f-f25bdb30605d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:28.845270 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e95b8e44-b55d-42a7-b71f-f25bdb30605d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:28.846079 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e95b8e44-b55d-42a7-b71f-f25bdb30605d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:28.846547 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e95b8e44-b55d-42a7-b71f-f25bdb30605d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:29.078334 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e95b8e44-b55d-42a7-b71f-f25bdb30605d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:29.097464 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4a64065a-a5c7-4289-a402-e9a06bc9b906 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:29.100756 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e95b8e44-b55d-42a7-b71f-f25bdb30605d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1371 microversion: 2.1 time: 0.287745 Jun 16 19:46:29.107081 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4a64065a-a5c7-4289-a402-e9a06bc9b906 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1314 microversion: 2.1 time: 0.404331 Jun 16 19:46:29.111828 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 217/430] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:28 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:29.119264 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 214/431] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:28 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:29.131131 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b33ac023-4400-48c6-8a75-a3cfaa43a5bc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:29.133860 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b33ac023-4400-48c6-8a75-a3cfaa43a5bc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:29.149129 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b33ac023-4400-48c6-8a75-a3cfaa43a5bc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:29.149935 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b33ac023-4400-48c6-8a75-a3cfaa43a5bc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:29.153252 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b33ac023-4400-48c6-8a75-a3cfaa43a5bc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:29.155046 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b33ac023-4400-48c6-8a75-a3cfaa43a5bc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:29.526704 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b33ac023-4400-48c6-8a75-a3cfaa43a5bc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:29.545715 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b33ac023-4400-48c6-8a75-a3cfaa43a5bc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:29.547443 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b33ac023-4400-48c6-8a75-a3cfaa43a5bc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:29.549151 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b33ac023-4400-48c6-8a75-a3cfaa43a5bc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1738 microversion: 2.20 time: 0.435833 Jun 16 19:46:29.550242 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 218/432] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:29 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1738 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:30.125761 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b048a2fd-d9f2-4ddf-afb4-6711a91e1276 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:30.130549 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-fe5001cd-6710-4106-b0e9-49d9559b80be tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:30.131977 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-fe5001cd-6710-4106-b0e9-49d9559b80be tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:30.133266 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b048a2fd-d9f2-4ddf-afb4-6711a91e1276 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:30.148815 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b048a2fd-d9f2-4ddf-afb4-6711a91e1276 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:30.149070 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:30.154052 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b048a2fd-d9f2-4ddf-afb4-6711a91e1276 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:30.156214 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b048a2fd-d9f2-4ddf-afb4-6711a91e1276 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:30.160185 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b048a2fd-d9f2-4ddf-afb4-6711a91e1276 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:30.177076 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fe5001cd-6710-4106-b0e9-49d9559b80be tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:30.183741 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fe5001cd-6710-4106-b0e9-49d9559b80be tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:30.187545 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fe5001cd-6710-4106-b0e9-49d9559b80be tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:30.189246 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fe5001cd-6710-4106-b0e9-49d9559b80be tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:30.456488 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b048a2fd-d9f2-4ddf-afb4-6711a91e1276 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:30.468499 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-fe5001cd-6710-4106-b0e9-49d9559b80be tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:30.469551 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b048a2fd-d9f2-4ddf-afb4-6711a91e1276 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1314 microversion: 2.1 time: 0.350083 Jun 16 19:46:30.476485 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-fe5001cd-6710-4106-b0e9-49d9559b80be tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1564 microversion: 2.1 time: 0.352453 Jun 16 19:46:30.478650 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 219/433] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:30 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1564 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:30.479007 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 215/434] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:30 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:30.507914 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a5dd6729-fa8d-497d-ad1b-cbf230b1ce5e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:30.508761 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a5dd6729-fa8d-497d-ad1b-cbf230b1ce5e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:30.519631 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a5dd6729-fa8d-497d-ad1b-cbf230b1ce5e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:30.521719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a5dd6729-fa8d-497d-ad1b-cbf230b1ce5e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:30.525857 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a5dd6729-fa8d-497d-ad1b-cbf230b1ce5e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:30.526467 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a5dd6729-fa8d-497d-ad1b-cbf230b1ce5e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:30.568228 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c9f7dae6-5bd2-4fff-933b-9f81935c1169 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:30.568930 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c9f7dae6-5bd2-4fff-933b-9f81935c1169 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:30.583083 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c9f7dae6-5bd2-4fff-933b-9f81935c1169 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:30.583640 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c9f7dae6-5bd2-4fff-933b-9f81935c1169 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:30.584464 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c9f7dae6-5bd2-4fff-933b-9f81935c1169 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:30.585054 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c9f7dae6-5bd2-4fff-933b-9f81935c1169 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:30.638437 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:30.657375 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a5dd6729-fa8d-497d-ad1b-cbf230b1ce5e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163510 Jun 16 19:46:30.664851 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 220/435] 10.222.0.36 () {58 vars in 1274 bytes} [Thu Jun 16 19:46:30 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:46:30.903649 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c9f7dae6-5bd2-4fff-933b-9f81935c1169 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:30.927643 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c9f7dae6-5bd2-4fff-933b-9f81935c1169 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:30.929168 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c9f7dae6-5bd2-4fff-933b-9f81935c1169 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:30.930375 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c9f7dae6-5bd2-4fff-933b-9f81935c1169 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1738 microversion: 2.20 time: 0.366449 Jun 16 19:46:30.942289 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 216/436] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:30 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1738 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:31.491455 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-01e0c83c-d0e3-4991-b86f-d71db3d3af17 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:31.492081 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-01e0c83c-d0e3-4991-b86f-d71db3d3af17 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:31.502177 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-01e0c83c-d0e3-4991-b86f-d71db3d3af17 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:31.502974 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-01e0c83c-d0e3-4991-b86f-d71db3d3af17 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:31.503972 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-01e0c83c-d0e3-4991-b86f-d71db3d3af17 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:31.504485 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-01e0c83c-d0e3-4991-b86f-d71db3d3af17 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:31.950049 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-699bd149-ffbe-48e9-a829-a76f22a1326e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:31.950742 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-699bd149-ffbe-48e9-a829-a76f22a1326e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:31.960803 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-699bd149-ffbe-48e9-a829-a76f22a1326e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:31.961553 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-699bd149-ffbe-48e9-a829-a76f22a1326e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:31.962027 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-699bd149-ffbe-48e9-a829-a76f22a1326e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:31.962465 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-699bd149-ffbe-48e9-a829-a76f22a1326e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:32.086599 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-01e0c83c-d0e3-4991-b86f-d71db3d3af17 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:32.122092 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-01e0c83c-d0e3-4991-b86f-d71db3d3af17 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1314 microversion: 2.1 time: 0.632319 Jun 16 19:46:32.123311 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 221/437] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:31 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:32.268660 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-708e25fc-1b87-4242-9403-5cea04d6c22d req-28ef490c-69b0-4eb7-8089-71769735fcc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3abc0598-490a-4217-9fad-bb38f5fa15c7", "name": "network-vif-plugged", "status": "completed", "tag": "a8bc1f61-9f0d-4829-a38f-8059afd21d69"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:32.284863 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-708e25fc-1b87-4242-9403-5cea04d6c22d req-28ef490c-69b0-4eb7-8089-71769735fcc1 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:32.285393 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-708e25fc-1b87-4242-9403-5cea04d6c22d req-28ef490c-69b0-4eb7-8089-71769735fcc1 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:32.337086 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-708e25fc-1b87-4242-9403-5cea04d6c22d req-28ef490c-69b0-4eb7-8089-71769735fcc1 service nova] Creating event network-vif-plugged:a8bc1f61-9f0d-4829-a38f-8059afd21d69 for instance 3abc0598-490a-4217-9fad-bb38f5fa15c7 on hv-cinder-84617 Jun 16 19:46:32.351921 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-699bd149-ffbe-48e9-a829-a76f22a1326e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:32.360686 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-708e25fc-1b87-4242-9403-5cea04d6c22d req-28ef490c-69b0-4eb7-8089-71769735fcc1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095482 Jun 16 19:46:32.365073 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-699bd149-ffbe-48e9-a829-a76f22a1326e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:32.372268 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 222/438] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:46:32.375197 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-699bd149-ffbe-48e9-a829-a76f22a1326e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:32.379126 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-699bd149-ffbe-48e9-a829-a76f22a1326e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1738 microversion: 2.20 time: 0.433048 Jun 16 19:46:32.380539 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 217/439] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:31 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1738 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:46:33.142095 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e337eb4a-dccd-42f7-8cc1-7c08bb5ad025 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:33.143036 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e337eb4a-dccd-42f7-8cc1-7c08bb5ad025 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:33.181496 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e337eb4a-dccd-42f7-8cc1-7c08bb5ad025 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:33.186337 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e337eb4a-dccd-42f7-8cc1-7c08bb5ad025 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:33.190644 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e337eb4a-dccd-42f7-8cc1-7c08bb5ad025 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:33.196101 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e337eb4a-dccd-42f7-8cc1-7c08bb5ad025 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:33.403520 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c624b6c9-7cd2-4d46-98d0-1aafe8aaa78c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:33.404143 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c624b6c9-7cd2-4d46-98d0-1aafe8aaa78c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:33.428071 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c624b6c9-7cd2-4d46-98d0-1aafe8aaa78c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:33.428551 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c624b6c9-7cd2-4d46-98d0-1aafe8aaa78c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:33.468401 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c624b6c9-7cd2-4d46-98d0-1aafe8aaa78c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:33.468976 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c624b6c9-7cd2-4d46-98d0-1aafe8aaa78c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:33.760523 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e337eb4a-dccd-42f7-8cc1-7c08bb5ad025 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:33.769010 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e337eb4a-dccd-42f7-8cc1-7c08bb5ad025 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1314 microversion: 2.1 time: 0.631863 Jun 16 19:46:33.775705 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 223/440] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:33 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:33.823943 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c624b6c9-7cd2-4d46-98d0-1aafe8aaa78c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:33.838278 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c624b6c9-7cd2-4d46-98d0-1aafe8aaa78c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:33.844410 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c624b6c9-7cd2-4d46-98d0-1aafe8aaa78c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:33.847109 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c624b6c9-7cd2-4d46-98d0-1aafe8aaa78c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1738 microversion: 2.20 time: 0.451848 Jun 16 19:46:33.854965 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 218/441] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:33 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1738 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:46:33.895489 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-9679c4aa-3e12-44f8-b6fa-065e530d10b0 req-38529ab8-ab95-44fa-ae0d-e0f810da36d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea242cf7-0535-4532-aaa0-59848bf41c73", "tag": "521225d6-b4cf-4644-b00e-7e1640cf92c7"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:33.908661 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-9679c4aa-3e12-44f8-b6fa-065e530d10b0 req-38529ab8-ab95-44fa-ae0d-e0f810da36d2 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:33.909097 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-9679c4aa-3e12-44f8-b6fa-065e530d10b0 req-38529ab8-ab95-44fa-ae0d-e0f810da36d2 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:33.932339 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-9679c4aa-3e12-44f8-b6fa-065e530d10b0 req-38529ab8-ab95-44fa-ae0d-e0f810da36d2 service nova] Creating event network-changed:521225d6-b4cf-4644-b00e-7e1640cf92c7 for instance ea242cf7-0535-4532-aaa0-59848bf41c73 on hv-cinder-84617 Jun 16 19:46:33.950659 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-9679c4aa-3e12-44f8-b6fa-065e530d10b0 req-38529ab8-ab95-44fa-ae0d-e0f810da36d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067561 Jun 16 19:46:33.954160 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 224/442] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:46:34.792179 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a9102cd3-ae5d-43dd-a6b1-3d3b28594aa1 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:34.792813 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a9102cd3-ae5d-43dd-a6b1-3d3b28594aa1 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:34.800657 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a9102cd3-ae5d-43dd-a6b1-3d3b28594aa1 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:34.801126 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a9102cd3-ae5d-43dd-a6b1-3d3b28594aa1 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:34.801883 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a9102cd3-ae5d-43dd-a6b1-3d3b28594aa1 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:34.807531 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a9102cd3-ae5d-43dd-a6b1-3d3b28594aa1 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:34.879001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-64afee06-0aed-400f-823b-f5c866ae6cea tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:34.888187 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-64afee06-0aed-400f-823b-f5c866ae6cea tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:34.918949 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-64afee06-0aed-400f-823b-f5c866ae6cea tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:34.919587 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-64afee06-0aed-400f-823b-f5c866ae6cea tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:34.920408 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-64afee06-0aed-400f-823b-f5c866ae6cea tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:34.920844 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-64afee06-0aed-400f-823b-f5c866ae6cea tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:35.141418 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a9102cd3-ae5d-43dd-a6b1-3d3b28594aa1 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:35.160630 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a9102cd3-ae5d-43dd-a6b1-3d3b28594aa1 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1314 microversion: 2.1 time: 0.372125 Jun 16 19:46:35.161228 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 219/443] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:34 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:35.425346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-64afee06-0aed-400f-823b-f5c866ae6cea tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:35.434766 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-64afee06-0aed-400f-823b-f5c866ae6cea tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:35.441905 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-64afee06-0aed-400f-823b-f5c866ae6cea tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:35.443510 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-64afee06-0aed-400f-823b-f5c866ae6cea tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1738 microversion: 2.20 time: 0.569535 Jun 16 19:46:35.454660 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 225/444] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:34 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1738 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:46:36.202445 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b16be32f-bca8-4bfe-8ef5-5a481705437b tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:36.205658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b16be32f-bca8-4bfe-8ef5-5a481705437b tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:36.222411 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b16be32f-bca8-4bfe-8ef5-5a481705437b tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:36.245983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b16be32f-bca8-4bfe-8ef5-5a481705437b tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:36.253474 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b16be32f-bca8-4bfe-8ef5-5a481705437b tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:36.253889 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b16be32f-bca8-4bfe-8ef5-5a481705437b tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:36.474172 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-81cfa334-6253-4db4-b1f0-681ab65763be tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:36.474985 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-81cfa334-6253-4db4-b1f0-681ab65763be tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:36.499605 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-81cfa334-6253-4db4-b1f0-681ab65763be tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:36.506214 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-81cfa334-6253-4db4-b1f0-681ab65763be tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:36.507564 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-81cfa334-6253-4db4-b1f0-681ab65763be tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:36.511483 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-81cfa334-6253-4db4-b1f0-681ab65763be tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:36.604219 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b16be32f-bca8-4bfe-8ef5-5a481705437b tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:36.619635 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b16be32f-bca8-4bfe-8ef5-5a481705437b tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1497 microversion: 2.1 time: 0.440839 Jun 16 19:46:36.619635 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 220/445] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:36 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1497 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:36.816661 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-81cfa334-6253-4db4-b1f0-681ab65763be tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:36.831509 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-81cfa334-6253-4db4-b1f0-681ab65763be tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:36.833294 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-81cfa334-6253-4db4-b1f0-681ab65763be tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:36.836029 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-81cfa334-6253-4db4-b1f0-681ab65763be tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1738 microversion: 2.20 time: 0.365979 Jun 16 19:46:36.847502 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 226/446] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:36 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1738 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:46:37.856913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-01c721be-a31b-46f6-98c0-24f1291c99fc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:37.858200 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-01c721be-a31b-46f6-98c0-24f1291c99fc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:37.865214 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01c721be-a31b-46f6-98c0-24f1291c99fc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:37.865667 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01c721be-a31b-46f6-98c0-24f1291c99fc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:37.866645 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01c721be-a31b-46f6-98c0-24f1291c99fc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:37.867273 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01c721be-a31b-46f6-98c0-24f1291c99fc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:38.081616 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-01c721be-a31b-46f6-98c0-24f1291c99fc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:38.090972 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-01c721be-a31b-46f6-98c0-24f1291c99fc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:38.096980 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-01c721be-a31b-46f6-98c0-24f1291c99fc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:38.103912 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-01c721be-a31b-46f6-98c0-24f1291c99fc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1738 microversion: 2.20 time: 0.253715 Jun 16 19:46:38.104842 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 221/447] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:37 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:46:39.123419 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0d7c9631-53dd-4c1c-9833-da758628b9ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:39.125395 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0d7c9631-53dd-4c1c-9833-da758628b9ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:39.134469 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0d7c9631-53dd-4c1c-9833-da758628b9ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:39.135218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0d7c9631-53dd-4c1c-9833-da758628b9ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:39.135992 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0d7c9631-53dd-4c1c-9833-da758628b9ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:39.136460 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0d7c9631-53dd-4c1c-9833-da758628b9ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:39.302858 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0d7c9631-53dd-4c1c-9833-da758628b9ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:39.320256 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0d7c9631-53dd-4c1c-9833-da758628b9ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:39.330583 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0d7c9631-53dd-4c1c-9833-da758628b9ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:39.330583 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0d7c9631-53dd-4c1c-9833-da758628b9ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1738 microversion: 2.20 time: 0.205141 Jun 16 19:46:39.330583 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 227/448] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:39 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:46:40.343539 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6b515334-7428-46f9-be94-e35c233b8216 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:40.344188 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6b515334-7428-46f9-be94-e35c233b8216 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:40.356094 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6b515334-7428-46f9-be94-e35c233b8216 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:40.356814 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6b515334-7428-46f9-be94-e35c233b8216 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:40.359709 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6b515334-7428-46f9-be94-e35c233b8216 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:40.360329 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6b515334-7428-46f9-be94-e35c233b8216 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:40.606979 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-93b11cdf-86ea-43e1-ad88-d59cb1e81399 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:40.609940 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-93b11cdf-86ea-43e1-ad88-d59cb1e81399 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:40.624700 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-93b11cdf-86ea-43e1-ad88-d59cb1e81399 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:40.641188 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-93b11cdf-86ea-43e1-ad88-d59cb1e81399 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:40.642443 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-93b11cdf-86ea-43e1-ad88-d59cb1e81399 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:40.643221 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-93b11cdf-86ea-43e1-ad88-d59cb1e81399 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:40.720908 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-93b11cdf-86ea-43e1-ad88-d59cb1e81399 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Going to try to terminate instance {{(pid=124551) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:46:40.935238 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6b515334-7428-46f9-be94-e35c233b8216 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:40.954134 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6b515334-7428-46f9-be94-e35c233b8216 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:40.954134 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6b515334-7428-46f9-be94-e35c233b8216 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:40.954134 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6b515334-7428-46f9-be94-e35c233b8216 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1738 microversion: 2.20 time: 0.615245 Jun 16 19:46:40.961702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 222/449] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:40 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1738 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:41.358695 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-93b11cdf-86ea-43e1-ad88-d59cb1e81399 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 204 len: 0 microversion: 2.1 time: 0.759926 Jun 16 19:46:41.359629 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 228/450] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:46:40 2022] DELETE /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:46:41.368262 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a9c4bb5c-70ae-4d15-8ea3-1164e6ae086e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:41.369643 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a9c4bb5c-70ae-4d15-8ea3-1164e6ae086e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:41.381910 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a9c4bb5c-70ae-4d15-8ea3-1164e6ae086e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:41.382660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a9c4bb5c-70ae-4d15-8ea3-1164e6ae086e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:41.383888 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a9c4bb5c-70ae-4d15-8ea3-1164e6ae086e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:41.384479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a9c4bb5c-70ae-4d15-8ea3-1164e6ae086e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:41.666062 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a9c4bb5c-70ae-4d15-8ea3-1164e6ae086e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:41.675312 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a9c4bb5c-70ae-4d15-8ea3-1164e6ae086e tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1503 microversion: 2.1 time: 0.310848 Jun 16 19:46:41.679586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 223/451] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:41 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1503 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:41.985533 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e32dfba5-8880-4859-a0d9-ff736c3e9bc3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:41.986361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e32dfba5-8880-4859-a0d9-ff736c3e9bc3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:41.996580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e32dfba5-8880-4859-a0d9-ff736c3e9bc3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:41.997036 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e32dfba5-8880-4859-a0d9-ff736c3e9bc3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:41.997826 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e32dfba5-8880-4859-a0d9-ff736c3e9bc3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:41.998265 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e32dfba5-8880-4859-a0d9-ff736c3e9bc3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:42.004457 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:42.188106 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e32dfba5-8880-4859-a0d9-ff736c3e9bc3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:42.188106 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e32dfba5-8880-4859-a0d9-ff736c3e9bc3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:42.188395 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e32dfba5-8880-4859-a0d9-ff736c3e9bc3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:42.188395 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e32dfba5-8880-4859-a0d9-ff736c3e9bc3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1738 microversion: 2.20 time: 0.197003 Jun 16 19:46:42.189655 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 229/452] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:41 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:42.697052 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-35abc472-5edc-4a35-9388-8e765c8ac906 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:42.698328 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-35abc472-5edc-4a35-9388-8e765c8ac906 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:42.706331 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-35abc472-5edc-4a35-9388-8e765c8ac906 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:42.707093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-35abc472-5edc-4a35-9388-8e765c8ac906 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:42.707859 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-35abc472-5edc-4a35-9388-8e765c8ac906 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:42.708299 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-35abc472-5edc-4a35-9388-8e765c8ac906 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:42.854634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-35abc472-5edc-4a35-9388-8e765c8ac906 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:42.865756 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-35abc472-5edc-4a35-9388-8e765c8ac906 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1503 microversion: 2.1 time: 0.173022 Jun 16 19:46:42.866337 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 224/453] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:42 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:43.193501 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5b7e77dc-230f-4808-80d9-6aac0a7124f6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:43.195821 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5b7e77dc-230f-4808-80d9-6aac0a7124f6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:43.210749 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5b7e77dc-230f-4808-80d9-6aac0a7124f6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:43.214721 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5b7e77dc-230f-4808-80d9-6aac0a7124f6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:43.216231 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5b7e77dc-230f-4808-80d9-6aac0a7124f6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:43.216684 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5b7e77dc-230f-4808-80d9-6aac0a7124f6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:43.402157 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5b7e77dc-230f-4808-80d9-6aac0a7124f6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:43.410844 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5b7e77dc-230f-4808-80d9-6aac0a7124f6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:43.412370 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5b7e77dc-230f-4808-80d9-6aac0a7124f6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:43.413551 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5b7e77dc-230f-4808-80d9-6aac0a7124f6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1738 microversion: 2.20 time: 0.223803 Jun 16 19:46:43.414497 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 230/454] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:43 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:43.883387 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a83af36f-a265-403c-bdd3-b920a8cee641 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:43.884028 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a83af36f-a265-403c-bdd3-b920a8cee641 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:43.890763 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a83af36f-a265-403c-bdd3-b920a8cee641 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:43.893074 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a83af36f-a265-403c-bdd3-b920a8cee641 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:43.894186 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a83af36f-a265-403c-bdd3-b920a8cee641 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:43.894624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a83af36f-a265-403c-bdd3-b920a8cee641 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:44.047946 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a83af36f-a265-403c-bdd3-b920a8cee641 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:44.061650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a83af36f-a265-403c-bdd3-b920a8cee641 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1503 microversion: 2.1 time: 0.182061 Jun 16 19:46:44.062478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 225/455] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:43 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:44.436284 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-597c8348-bf14-4e60-a7e8-c9b1f45129a3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:44.436976 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-597c8348-bf14-4e60-a7e8-c9b1f45129a3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:44.446267 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-597c8348-bf14-4e60-a7e8-c9b1f45129a3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:44.446802 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-597c8348-bf14-4e60-a7e8-c9b1f45129a3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:44.450599 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-597c8348-bf14-4e60-a7e8-c9b1f45129a3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:44.451431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-597c8348-bf14-4e60-a7e8-c9b1f45129a3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:44.605021 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-597c8348-bf14-4e60-a7e8-c9b1f45129a3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:44.614089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-597c8348-bf14-4e60-a7e8-c9b1f45129a3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:44.628131 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-597c8348-bf14-4e60-a7e8-c9b1f45129a3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:44.628131 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-597c8348-bf14-4e60-a7e8-c9b1f45129a3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1738 microversion: 2.20 time: 0.188510 Jun 16 19:46:44.628131 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 231/456] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:44 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:45.078992 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-57144628-61ee-4f46-9d86-7513de8810f1 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:45.080145 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-57144628-61ee-4f46-9d86-7513de8810f1 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:45.087793 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-57144628-61ee-4f46-9d86-7513de8810f1 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:45.090439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-57144628-61ee-4f46-9d86-7513de8810f1 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:45.091798 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-57144628-61ee-4f46-9d86-7513de8810f1 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:45.095323 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-57144628-61ee-4f46-9d86-7513de8810f1 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:45.539440 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-57144628-61ee-4f46-9d86-7513de8810f1 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:45.547636 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-57144628-61ee-4f46-9d86-7513de8810f1 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1503 microversion: 2.1 time: 0.471924 Jun 16 19:46:45.557429 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 226/457] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:45 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1503 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:45.642269 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9ca46a95-e94e-4829-8fbb-1cb67cc9643b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:45.642894 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9ca46a95-e94e-4829-8fbb-1cb67cc9643b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:45.672625 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9ca46a95-e94e-4829-8fbb-1cb67cc9643b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:45.673083 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9ca46a95-e94e-4829-8fbb-1cb67cc9643b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:45.673876 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9ca46a95-e94e-4829-8fbb-1cb67cc9643b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:45.674318 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9ca46a95-e94e-4829-8fbb-1cb67cc9643b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:45.869604 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9ca46a95-e94e-4829-8fbb-1cb67cc9643b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:45.882799 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9ca46a95-e94e-4829-8fbb-1cb67cc9643b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:45.884918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9ca46a95-e94e-4829-8fbb-1cb67cc9643b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:45.886406 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9ca46a95-e94e-4829-8fbb-1cb67cc9643b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1738 microversion: 2.20 time: 0.248648 Jun 16 19:46:45.887336 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 232/458] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:45 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1738 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:46.600076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-dc2b6414-8246-4aa7-88e9-69472e01d899 req-273466af-ea2d-4809-abea-6ae1fa627743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3abc0598-490a-4217-9fad-bb38f5fa15c7", "name": "network-vif-deleted", "tag": "a8bc1f61-9f0d-4829-a38f-8059afd21d69"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:46.600076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-dc2b6414-8246-4aa7-88e9-69472e01d899 req-273466af-ea2d-4809-abea-6ae1fa627743 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:46.600076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-dc2b6414-8246-4aa7-88e9-69472e01d899 req-273466af-ea2d-4809-abea-6ae1fa627743 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:46.600076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-dc2b6414-8246-4aa7-88e9-69472e01d899 req-273466af-ea2d-4809-abea-6ae1fa627743 service nova] Creating event network-vif-deleted:a8bc1f61-9f0d-4829-a38f-8059afd21d69 for instance 3abc0598-490a-4217-9fad-bb38f5fa15c7 on hv-cinder-84617 Jun 16 19:46:46.600796 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-86101ccf-79c3-4bc7-bc26-5d5e7740bf46 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:46.600796 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-86101ccf-79c3-4bc7-bc26-5d5e7740bf46 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:46.600974 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-dc2b6414-8246-4aa7-88e9-69472e01d899 req-273466af-ea2d-4809-abea-6ae1fa627743 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027760 Jun 16 19:46:46.600974 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 227/459] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:46:46.601214 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-86101ccf-79c3-4bc7-bc26-5d5e7740bf46 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:46.601214 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-86101ccf-79c3-4bc7-bc26-5d5e7740bf46 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:46.601214 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-86101ccf-79c3-4bc7-bc26-5d5e7740bf46 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:46.601214 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-86101ccf-79c3-4bc7-bc26-5d5e7740bf46 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:46.645165 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-86101ccf-79c3-4bc7-bc26-5d5e7740bf46 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:46.653347 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-86101ccf-79c3-4bc7-bc26-5d5e7740bf46 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1461 microversion: 2.1 time: 0.092777 Jun 16 19:46:46.653905 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 233/460] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:46 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1461 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:46.906134 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1f5f8202-f4aa-45a9-81b3-d94eeadff4bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:46.906755 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1f5f8202-f4aa-45a9-81b3-d94eeadff4bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:46.912946 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1f5f8202-f4aa-45a9-81b3-d94eeadff4bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:46.913399 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1f5f8202-f4aa-45a9-81b3-d94eeadff4bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:46.914159 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1f5f8202-f4aa-45a9-81b3-d94eeadff4bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:46.914595 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1f5f8202-f4aa-45a9-81b3-d94eeadff4bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:47.051675 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1f5f8202-f4aa-45a9-81b3-d94eeadff4bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:47.059541 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1f5f8202-f4aa-45a9-81b3-d94eeadff4bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:47.061053 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1f5f8202-f4aa-45a9-81b3-d94eeadff4bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:47.062206 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1f5f8202-f4aa-45a9-81b3-d94eeadff4bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1738 microversion: 2.20 time: 0.160967 Jun 16 19:46:47.062758 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 228/461] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:46 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:47.669619 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c046c17d-cc69-4d3d-a272-cec6533086f4 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:47.670477 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c046c17d-cc69-4d3d-a272-cec6533086f4 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:47.676613 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c046c17d-cc69-4d3d-a272-cec6533086f4 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:47.677555 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c046c17d-cc69-4d3d-a272-cec6533086f4 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:47.677955 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c046c17d-cc69-4d3d-a272-cec6533086f4 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:47.678393 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c046c17d-cc69-4d3d-a272-cec6533086f4 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:47.741854 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c046c17d-cc69-4d3d-a272-cec6533086f4 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:47.749685 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c046c17d-cc69-4d3d-a272-cec6533086f4 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1299 microversion: 2.1 time: 0.084023 Jun 16 19:46:47.750243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 234/462] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:47 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:48.080761 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a5abe119-b55e-4865-bd72-54b3c1fa5fdf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:48.081520 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a5abe119-b55e-4865-bd72-54b3c1fa5fdf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:48.087974 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a5abe119-b55e-4865-bd72-54b3c1fa5fdf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:48.088527 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a5abe119-b55e-4865-bd72-54b3c1fa5fdf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:48.089422 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a5abe119-b55e-4865-bd72-54b3c1fa5fdf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:48.089852 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a5abe119-b55e-4865-bd72-54b3c1fa5fdf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:48.272565 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a5abe119-b55e-4865-bd72-54b3c1fa5fdf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:48.280981 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a5abe119-b55e-4865-bd72-54b3c1fa5fdf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:48.282476 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a5abe119-b55e-4865-bd72-54b3c1fa5fdf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:48.283665 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a5abe119-b55e-4865-bd72-54b3c1fa5fdf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1738 microversion: 2.20 time: 0.207143 Jun 16 19:46:48.284213 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 229/463] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:48 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:48.766768 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8c194560-42d7-4d43-80b5-75b40666117d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:48.767425 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8c194560-42d7-4d43-80b5-75b40666117d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:48.773830 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8c194560-42d7-4d43-80b5-75b40666117d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:48.774301 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8c194560-42d7-4d43-80b5-75b40666117d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:48.775089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8c194560-42d7-4d43-80b5-75b40666117d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:48.775528 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8c194560-42d7-4d43-80b5-75b40666117d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:48.805974 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8c194560-42d7-4d43-80b5-75b40666117d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:48.806420 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8c194560-42d7-4d43-80b5-75b40666117d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:48.806862 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-8c194560-42d7-4d43-80b5-75b40666117d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lazy-loading 'fault' on Instance uuid 3abc0598-490a-4217-9fad-bb38f5fa15c7 {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:46:48.850447 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8c194560-42d7-4d43-80b5-75b40666117d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:48.860967 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8c194560-42d7-4d43-80b5-75b40666117d tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1304 microversion: 2.1 time: 0.096310 Jun 16 19:46:48.861542 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 235/464] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:48 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:49.302719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d5c83528-0344-42a8-9618-2d2a44c12389 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:49.303287 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d5c83528-0344-42a8-9618-2d2a44c12389 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:49.309696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d5c83528-0344-42a8-9618-2d2a44c12389 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:49.310132 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d5c83528-0344-42a8-9618-2d2a44c12389 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:49.310877 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d5c83528-0344-42a8-9618-2d2a44c12389 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:49.311326 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d5c83528-0344-42a8-9618-2d2a44c12389 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:49.437014 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d5c83528-0344-42a8-9618-2d2a44c12389 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:49.445207 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d5c83528-0344-42a8-9618-2d2a44c12389 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:49.446728 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d5c83528-0344-42a8-9618-2d2a44c12389 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:49.447896 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d5c83528-0344-42a8-9618-2d2a44c12389 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1738 microversion: 2.20 time: 0.149120 Jun 16 19:46:49.448495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 230/465] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:49 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:49.574618 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-44d08de8-7831-45ea-ba57-fd70494b1e1e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Action: 'create', calling method: .version_select at 0x7f05016afa60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-463263915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBH8cSOgSO+yYpGrHtWzsK24QN0blLQp19b+VkaGGgDcOu5JFmT8I3DoDD6venrQj+xIcM+cBNVBRj3MiB6APWBN2VeyJkA7vbDZgIRi3ff1oy6EAQyxl2t6HJzT9fZ7LQ=="}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:49.603081 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-44d08de8-7831-45ea-ba57-fd70494b1e1e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Getting quotas for project 2ab754ce6b844222af7ddb23f93aa648. Resources: {'key_pairs'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:46:49.608936 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-44d08de8-7831-45ea-ba57-fd70494b1e1e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Getting quotas for user 88446ec114864875a88a20d634b4423a and project 2ab754ce6b844222af7ddb23f93aa648. Resources: {'key_pairs'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:46:49.621758 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR oslo.messaging._drivers.impl_rabbit [None req-44d08de8-7831-45ea-ba57-fd70494b1e1e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [a92cb0e4-2d5c-49ec-8b2a-fb32881905e4] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 19:46:49.877533 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-00f72498-32f2-4882-9052-fa97e1e9dcde tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:49.878131 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-00f72498-32f2-4882-9052-fa97e1e9dcde tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:49.883970 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-00f72498-32f2-4882-9052-fa97e1e9dcde tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:49.884407 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-00f72498-32f2-4882-9052-fa97e1e9dcde tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:49.885147 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-00f72498-32f2-4882-9052-fa97e1e9dcde tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:49.885574 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-00f72498-32f2-4882-9052-fa97e1e9dcde tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:49.916710 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-00f72498-32f2-4882-9052-fa97e1e9dcde tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:49.917154 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-00f72498-32f2-4882-9052-fa97e1e9dcde tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:49.917676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-00f72498-32f2-4882-9052-fa97e1e9dcde tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lazy-loading 'fault' on Instance uuid 3abc0598-490a-4217-9fad-bb38f5fa15c7 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:46:49.964570 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-00f72498-32f2-4882-9052-fa97e1e9dcde tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:49.972176 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-00f72498-32f2-4882-9052-fa97e1e9dcde tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1304 microversion: 2.1 time: 0.098450 Jun 16 19:46:49.972988 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 231/466] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:49 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:50.466608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a7c6f550-91e8-4a05-8153-52a7a751c729 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:50.467244 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a7c6f550-91e8-4a05-8153-52a7a751c729 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:50.473137 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a7c6f550-91e8-4a05-8153-52a7a751c729 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:50.473589 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a7c6f550-91e8-4a05-8153-52a7a751c729 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:50.474348 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a7c6f550-91e8-4a05-8153-52a7a751c729 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:50.474797 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a7c6f550-91e8-4a05-8153-52a7a751c729 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:50.599941 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a7c6f550-91e8-4a05-8153-52a7a751c729 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:50.608053 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a7c6f550-91e8-4a05-8153-52a7a751c729 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:50.609732 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a7c6f550-91e8-4a05-8153-52a7a751c729 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:50.610810 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a7c6f550-91e8-4a05-8153-52a7a751c729 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1738 microversion: 2.20 time: 0.148764 Jun 16 19:46:50.611483 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 232/467] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:50 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:46:50.629964 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO oslo.messaging._drivers.impl_rabbit [None req-44d08de8-7831-45ea-ba57-fd70494b1e1e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [a92cb0e4-2d5c-49ec-8b2a-fb32881905e4] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 57036. Jun 16 19:46:50.774063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-44d08de8-7831-45ea-ba57-fd70494b1e1e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.203282 Jun 16 19:46:50.774591 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 236/468] 10.222.0.36 () {60 vars in 1158 bytes} [Thu Jun 16 19:46:49 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:46:50.869856 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-513435d6-f679-46e9-a976-500b54584e3c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-50550841", "imageRef": "7e3d734c-e8cf-4fe1-8e01-c7b5f6d748fb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-463263915", "networks": [{"uuid": "d2e59bc1-b804-4935-9de6-ec12d1ec5ca4"}]}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:50.919814 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-513435d6-f679-46e9-a976-500b54584e3c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] validate_networks() for [('d2e59bc1-b804-4935-9de6-ec12d1ec5ca4', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:46:50.989512 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-4f9a46ca-333d-4059-a33a-5d2c25a0489c tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:50.990131 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-4f9a46ca-333d-4059-a33a-5d2c25a0489c tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:51.000452 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4f9a46ca-333d-4059-a33a-5d2c25a0489c tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:51.000914 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4f9a46ca-333d-4059-a33a-5d2c25a0489c tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:51.001692 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4f9a46ca-333d-4059-a33a-5d2c25a0489c tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:51.002131 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4f9a46ca-333d-4059-a33a-5d2c25a0489c tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:51.032230 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4f9a46ca-333d-4059-a33a-5d2c25a0489c tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:51.032927 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4f9a46ca-333d-4059-a33a-5d2c25a0489c tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:51.033377 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-4f9a46ca-333d-4059-a33a-5d2c25a0489c tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lazy-loading 'fault' on Instance uuid 3abc0598-490a-4217-9fad-bb38f5fa15c7 {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:46:51.076963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-4f9a46ca-333d-4059-a33a-5d2c25a0489c tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d74fdb719b40208ee408b838256a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca93a40aa85448a8e5165f4c268678a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:51.084572 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-4f9a46ca-333d-4059-a33a-5d2c25a0489c tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 200 len: 1304 microversion: 2.1 time: 0.099078 Jun 16 19:46:51.089172 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 237/469] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:50 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:51.291831 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-513435d6-f679-46e9-a976-500b54584e3c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:46:51.292824 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-513435d6-f679-46e9-a976-500b54584e3c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:46:51.293296 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-513435d6-f679-46e9-a976-500b54584e3c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:46:51.293707 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-513435d6-f679-46e9-a976-500b54584e3c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:46:51.294144 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-513435d6-f679-46e9-a976-500b54584e3c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:46:51.303381 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-513435d6-f679-46e9-a976-500b54584e3c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:51.303831 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-513435d6-f679-46e9-a976-500b54584e3c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:51.304614 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-513435d6-f679-46e9-a976-500b54584e3c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:51.305048 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-513435d6-f679-46e9-a976-500b54584e3c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:51.322046 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-513435d6-f679-46e9-a976-500b54584e3c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Getting quotas for project 2ab754ce6b844222af7ddb23f93aa648. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:46:51.325983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-513435d6-f679-46e9-a976-500b54584e3c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Getting quotas for user 88446ec114864875a88a20d634b4423a and project 2ab754ce6b844222af7ddb23f93aa648. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:46:51.336613 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-513435d6-f679-46e9-a976-500b54584e3c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:46:51.338748 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-513435d6-f679-46e9-a976-500b54584e3c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7e3d734c-e8cf-4fe1-8e01-c7b5f6d748fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:46:51.599723 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-513435d6-f679-46e9-a976-500b54584e3c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733686 Jun 16 19:46:51.601191 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 233/470] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:46:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:46:51.610834 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d312598a-9f0b-4bc8-84cf-b1b9ab0a19cd tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:51.611484 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d312598a-9f0b-4bc8-84cf-b1b9ab0a19cd tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:51.639381 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b52adfd4-c0af-4db2-a235-374f371ff584 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:51.641344 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b52adfd4-c0af-4db2-a235-374f371ff584 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:51.655821 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b52adfd4-c0af-4db2-a235-374f371ff584 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:51.657477 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b52adfd4-c0af-4db2-a235-374f371ff584 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:51.658481 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b52adfd4-c0af-4db2-a235-374f371ff584 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:51.659398 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b52adfd4-c0af-4db2-a235-374f371ff584 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:51.664793 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:46:51.676001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d312598a-9f0b-4bc8-84cf-b1b9ab0a19cd tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:51.682831 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d312598a-9f0b-4bc8-84cf-b1b9ab0a19cd tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1256 microversion: 2.1 time: 0.075922 Jun 16 19:46:51.699406 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 238/471] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:51 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1256 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:51.809870 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b52adfd4-c0af-4db2-a235-374f371ff584 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:51.817634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b52adfd4-c0af-4db2-a235-374f371ff584 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:51.819421 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b52adfd4-c0af-4db2-a235-374f371ff584 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:51.820575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b52adfd4-c0af-4db2-a235-374f371ff584 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1738 microversion: 2.20 time: 0.192081 Jun 16 19:46:51.821143 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 234/472] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:51 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:52.100235 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-723e850d-3d0e-4581-bae6-a69f60ff02f3 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:52.100979 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-723e850d-3d0e-4581-bae6-a69f60ff02f3 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] [instance: 3abc0598-490a-4217-9fad-bb38f5fa15c7] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:52.107995 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-723e850d-3d0e-4581-bae6-a69f60ff02f3 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:52.108380 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-723e850d-3d0e-4581-bae6-a69f60ff02f3 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:52.109133 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-723e850d-3d0e-4581-bae6-a69f60ff02f3 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:52.109572 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-723e850d-3d0e-4581-bae6-a69f60ff02f3 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:52.123270 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-723e850d-3d0e-4581-bae6-a69f60ff02f3 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] HTTP exception thrown: Instance 3abc0598-490a-4217-9fad-bb38f5fa15c7 could not be found. Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-723e850d-3d0e-4581-bae6-a69f60ff02f3 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Request method failure captured: Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 HTTP/1.1 Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4hmflkD_UcKhzR8swqxrHy0y-OQymB8pA7TyhRBXRuljLsUzEIV_z7EHlCz7Ak7L3K1ypaiWoJ-ciXZgikt3qL2pd6XRPJ5TnGvo0vZ1LzaABK1CSK-C49Sr5leg9HfIJSR9hPf6y6Z8OZx2jH3bslDQlvvdsWwkug2ODCERgFDSlI Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 7ca93a40aa85448a8e5165f4c268678a Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-VolumesActionsTest-440765112 Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:46:52.124958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:46:52.126878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7ca93a40aa85448a8e5165f4c268678a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7ca93a40aa85448a8e5165f4c268678a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7ca93a40aa85448a8e5165f4c268678a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7ca93a40aa85448a8e5165f4c268678a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:46:52.126878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-VolumesActionsTest-440765112 Jun 16 19:46:52.126878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 7ca93a40aa85448a8e5165f4c268678a Jun 16 19:46:52.126878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-VolumesActionsTest-440765112 Jun 16 19:46:52.126878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-VolumesActionsTest-440765112-project Jun 16 19:46:52.126878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:46:52.126878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:46:52.126878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 61d74fdb719b40208ee408b838256a0f Jun 16 19:46:52.126878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-VolumesActionsTest-440765112-project Jun 16 19:46:52.126878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:46:52.126878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance 3abc0598-490a-4217-9fad-bb38f5fa15c7 could not be found. Jun 16 19:46:52.126878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': '3abc0598-490a-4217-9fad-bb38f5fa15c7'} Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3abc0598-490a-4217-9fad-bb38f5fa15c7 could not be found. Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:46:52.127677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:46:52.128918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:46:52.128918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:46:52.128918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:46:52.128918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:46:52.128918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:46:52.128918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:46:52.128918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:46:52.128918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3abc0598-490a-4217-9fad-bb38f5fa15c7 could not be found. Jun 16 19:46:52.128918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:46:52.128918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:46:52.128918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:46:52.128918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:46:52.128918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:46:52.128918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:46:52.128918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:46:52.128918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:46:52.128918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3abc0598-490a-4217-9fad-bb38f5fa15c7 could not be found. Jun 16 19:46:52.128918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:46:52.130078 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-723e850d-3d0e-4581-bae6-a69f60ff02f3 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] Returning 404 to user: Instance 3abc0598-490a-4217-9fad-bb38f5fa15c7 could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:46:52.130078 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-723e850d-3d0e-4581-bae6-a69f60ff02f3 tempest-VolumesActionsTest-440765112 tempest-VolumesActionsTest-440765112-project] 10.222.0.36 "GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7" status: 404 len: 111 microversion: 2.1 time: 0.029957 Jun 16 19:46:52.130078 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 239/473] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:52 2022] GET /compute/v2.1/servers/3abc0598-490a-4217-9fad-bb38f5fa15c7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:46:52.700198 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-06b63d38-8051-4e96-bc93-19bca42c0542 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:52.700905 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-06b63d38-8051-4e96-bc93-19bca42c0542 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:52.755503 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-06b63d38-8051-4e96-bc93-19bca42c0542 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:52.762645 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-06b63d38-8051-4e96-bc93-19bca42c0542 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1256 microversion: 2.1 time: 0.066684 Jun 16 19:46:52.763236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 235/474] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:52 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1256 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:52.838442 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3f4d5f18-7039-4f7a-b1d0-b69068c4e228 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:52.839139 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-3f4d5f18-7039-4f7a-b1d0-b69068c4e228 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:52.845301 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3f4d5f18-7039-4f7a-b1d0-b69068c4e228 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:52.845757 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3f4d5f18-7039-4f7a-b1d0-b69068c4e228 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:52.846557 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3f4d5f18-7039-4f7a-b1d0-b69068c4e228 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:52.847022 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3f4d5f18-7039-4f7a-b1d0-b69068c4e228 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:52.977472 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3f4d5f18-7039-4f7a-b1d0-b69068c4e228 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:52.986079 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3f4d5f18-7039-4f7a-b1d0-b69068c4e228 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:52.987714 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3f4d5f18-7039-4f7a-b1d0-b69068c4e228 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:52.988853 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-3f4d5f18-7039-4f7a-b1d0-b69068c4e228 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1720 microversion: 2.20 time: 0.154286 Jun 16 19:46:52.989412 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 240/475] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:52 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:53.780008 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-057c8869-de93-4748-8fcd-fe0412fba03e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:53.780610 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-057c8869-de93-4748-8fcd-fe0412fba03e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:53.786890 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-057c8869-de93-4748-8fcd-fe0412fba03e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:53.787354 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-057c8869-de93-4748-8fcd-fe0412fba03e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:53.788104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-057c8869-de93-4748-8fcd-fe0412fba03e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:53.788530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-057c8869-de93-4748-8fcd-fe0412fba03e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:53.849033 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-057c8869-de93-4748-8fcd-fe0412fba03e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:53.856478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-057c8869-de93-4748-8fcd-fe0412fba03e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1260 microversion: 2.1 time: 0.080899 Jun 16 19:46:53.857039 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 236/476] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:53 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1260 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:54.013875 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-2c077802-d826-46bb-992c-dfb4dbcb51c7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:54.014477 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-2c077802-d826-46bb-992c-dfb4dbcb51c7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:54.020942 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2c077802-d826-46bb-992c-dfb4dbcb51c7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:54.021461 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2c077802-d826-46bb-992c-dfb4dbcb51c7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:54.022137 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2c077802-d826-46bb-992c-dfb4dbcb51c7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:54.022565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2c077802-d826-46bb-992c-dfb4dbcb51c7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:54.157773 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-2c077802-d826-46bb-992c-dfb4dbcb51c7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:54.166042 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-2c077802-d826-46bb-992c-dfb4dbcb51c7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:54.167621 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-2c077802-d826-46bb-992c-dfb4dbcb51c7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:54.168818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-2c077802-d826-46bb-992c-dfb4dbcb51c7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1720 microversion: 2.20 time: 0.159255 Jun 16 19:46:54.169314 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 241/477] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:54 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:54.873446 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2c06a1eb-6f72-4b5c-912a-96ab3ea2ef11 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:54.874059 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2c06a1eb-6f72-4b5c-912a-96ab3ea2ef11 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:54.880035 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2c06a1eb-6f72-4b5c-912a-96ab3ea2ef11 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:54.880487 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2c06a1eb-6f72-4b5c-912a-96ab3ea2ef11 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:54.881250 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2c06a1eb-6f72-4b5c-912a-96ab3ea2ef11 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:54.881689 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2c06a1eb-6f72-4b5c-912a-96ab3ea2ef11 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:54.941714 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2c06a1eb-6f72-4b5c-912a-96ab3ea2ef11 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:54.949346 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2c06a1eb-6f72-4b5c-912a-96ab3ea2ef11 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1260 microversion: 2.1 time: 0.080238 Jun 16 19:46:54.949981 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 237/478] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:54 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1260 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:55.187599 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c36c0c86-73e6-4670-8414-f0c48b59f2a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:55.188208 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c36c0c86-73e6-4670-8414-f0c48b59f2a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:55.194836 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c36c0c86-73e6-4670-8414-f0c48b59f2a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:55.195309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c36c0c86-73e6-4670-8414-f0c48b59f2a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:55.196054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c36c0c86-73e6-4670-8414-f0c48b59f2a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:55.196484 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c36c0c86-73e6-4670-8414-f0c48b59f2a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:55.329009 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c36c0c86-73e6-4670-8414-f0c48b59f2a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:55.336906 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c36c0c86-73e6-4670-8414-f0c48b59f2a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:55.338435 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c36c0c86-73e6-4670-8414-f0c48b59f2a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:55.340100 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c36c0c86-73e6-4670-8414-f0c48b59f2a0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1720 microversion: 2.20 time: 0.156432 Jun 16 19:46:55.340651 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 242/479] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:55 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:55.965517 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9d280ab6-9bc3-45bc-ba80-7a3ef161853d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:55.966150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9d280ab6-9bc3-45bc-ba80-7a3ef161853d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:55.972106 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d280ab6-9bc3-45bc-ba80-7a3ef161853d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:55.972571 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d280ab6-9bc3-45bc-ba80-7a3ef161853d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:55.973305 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d280ab6-9bc3-45bc-ba80-7a3ef161853d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:55.973736 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d280ab6-9bc3-45bc-ba80-7a3ef161853d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:56.033484 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9d280ab6-9bc3-45bc-ba80-7a3ef161853d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:56.041312 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9d280ab6-9bc3-45bc-ba80-7a3ef161853d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1260 microversion: 2.1 time: 0.079629 Jun 16 19:46:56.041884 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 238/480] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:55 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1260 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:56.360815 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8f7e9db4-eab1-4f9b-909c-bb9686fed5e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:56.361550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8f7e9db4-eab1-4f9b-909c-bb9686fed5e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:56.369564 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8f7e9db4-eab1-4f9b-909c-bb9686fed5e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:56.370006 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8f7e9db4-eab1-4f9b-909c-bb9686fed5e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:56.387059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8f7e9db4-eab1-4f9b-909c-bb9686fed5e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:56.387059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8f7e9db4-eab1-4f9b-909c-bb9686fed5e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:56.451677 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-5e1b652a-be06-4126-a5c4-125829fcdf5a req-ed2f58b0-8c87-4817-8d26-37280a2ab9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f667dde1-232e-4f14-917f-0a749279d6a8", "name": "network-vif-unplugged", "status": "completed", "tag": "ce7582ec-7186-425a-a407-f177022e1f52"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:56.460045 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-5e1b652a-be06-4126-a5c4-125829fcdf5a req-ed2f58b0-8c87-4817-8d26-37280a2ab9bb service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:56.460488 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-5e1b652a-be06-4126-a5c4-125829fcdf5a req-ed2f58b0-8c87-4817-8d26-37280a2ab9bb service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:56.472871 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-5e1b652a-be06-4126-a5c4-125829fcdf5a req-ed2f58b0-8c87-4817-8d26-37280a2ab9bb service nova] Creating event network-vif-unplugged:ce7582ec-7186-425a-a407-f177022e1f52 for instance f667dde1-232e-4f14-917f-0a749279d6a8 on hv-cinder-84617 Jun 16 19:46:56.477777 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-5e1b652a-be06-4126-a5c4-125829fcdf5a req-ed2f58b0-8c87-4817-8d26-37280a2ab9bb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030102 Jun 16 19:46:56.478838 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 239/481] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:46:56.510235 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8f7e9db4-eab1-4f9b-909c-bb9686fed5e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:56.518474 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8f7e9db4-eab1-4f9b-909c-bb9686fed5e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:56.521368 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8f7e9db4-eab1-4f9b-909c-bb9686fed5e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:56.522524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8f7e9db4-eab1-4f9b-909c-bb9686fed5e8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1720 microversion: 2.20 time: 0.168829 Jun 16 19:46:56.523388 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 243/482] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:56 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:57.058969 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c8cc9c23-b200-4711-bf98-4d7d500d53c1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:57.059667 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c8cc9c23-b200-4711-bf98-4d7d500d53c1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:57.065762 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c8cc9c23-b200-4711-bf98-4d7d500d53c1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:57.066204 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c8cc9c23-b200-4711-bf98-4d7d500d53c1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:57.066975 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c8cc9c23-b200-4711-bf98-4d7d500d53c1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:57.067415 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c8cc9c23-b200-4711-bf98-4d7d500d53c1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:57.128147 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c8cc9c23-b200-4711-bf98-4d7d500d53c1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:57.135376 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c8cc9c23-b200-4711-bf98-4d7d500d53c1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1260 microversion: 2.1 time: 0.080646 Jun 16 19:46:57.136443 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 240/483] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:57 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1260 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:57.540924 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a1a5fce6-7798-4e99-bbd2-6d838e64df19 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:57.542179 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a1a5fce6-7798-4e99-bbd2-6d838e64df19 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:57.548614 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1a5fce6-7798-4e99-bbd2-6d838e64df19 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:57.549061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1a5fce6-7798-4e99-bbd2-6d838e64df19 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:57.549836 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1a5fce6-7798-4e99-bbd2-6d838e64df19 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:57.550320 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1a5fce6-7798-4e99-bbd2-6d838e64df19 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:57.681306 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a1a5fce6-7798-4e99-bbd2-6d838e64df19 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:57.689302 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a1a5fce6-7798-4e99-bbd2-6d838e64df19 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:57.690906 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a1a5fce6-7798-4e99-bbd2-6d838e64df19 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:57.692103 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a1a5fce6-7798-4e99-bbd2-6d838e64df19 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1720 microversion: 2.20 time: 0.155024 Jun 16 19:46:57.692652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 244/484] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:57 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:58.152623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f96ab888-868a-4bc7-b457-0b9bbe9a930e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:58.153219 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f96ab888-868a-4bc7-b457-0b9bbe9a930e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:58.159568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f96ab888-868a-4bc7-b457-0b9bbe9a930e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:58.160013 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f96ab888-868a-4bc7-b457-0b9bbe9a930e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:58.160779 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f96ab888-868a-4bc7-b457-0b9bbe9a930e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:58.161242 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f96ab888-868a-4bc7-b457-0b9bbe9a930e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:58.224462 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f96ab888-868a-4bc7-b457-0b9bbe9a930e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:58.234593 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f96ab888-868a-4bc7-b457-0b9bbe9a930e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1308 microversion: 2.1 time: 0.083990 Jun 16 19:46:58.234593 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 241/485] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:58 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1308 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:46:58.710783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a1ad347e-f2ce-4940-8674-a6a79be2d930 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:58.711445 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a1ad347e-f2ce-4940-8674-a6a79be2d930 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:58.718490 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1ad347e-f2ce-4940-8674-a6a79be2d930 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:58.719147 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1ad347e-f2ce-4940-8674-a6a79be2d930 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:58.721220 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1ad347e-f2ce-4940-8674-a6a79be2d930 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:58.723184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1ad347e-f2ce-4940-8674-a6a79be2d930 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:58.884159 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a1ad347e-f2ce-4940-8674-a6a79be2d930 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:58.892476 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a1ad347e-f2ce-4940-8674-a6a79be2d930 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:58.894033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a1ad347e-f2ce-4940-8674-a6a79be2d930 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:58.895465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a1ad347e-f2ce-4940-8674-a6a79be2d930 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1723 microversion: 2.20 time: 0.188777 Jun 16 19:46:58.896050 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 245/486] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:46:58 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:46:58.917969 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-abf548dc-bfb3-404d-9255-7f4b8f4791a8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c36b914-8788-4717-8d99-351004eb6f74"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:46:58.917969 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-abf548dc-bfb3-404d-9255-7f4b8f4791a8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:58.922614 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-abf548dc-bfb3-404d-9255-7f4b8f4791a8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:58.939546 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-abf548dc-bfb3-404d-9255-7f4b8f4791a8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:58.939546 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-abf548dc-bfb3-404d-9255-7f4b8f4791a8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:58.939546 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-abf548dc-bfb3-404d-9255-7f4b8f4791a8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:59.249907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-af7ffec7-0366-43d4-900c-778b7a805002 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:59.250149 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-af7ffec7-0366-43d4-900c-778b7a805002 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:59.256971 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-af7ffec7-0366-43d4-900c-778b7a805002 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:59.257428 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-af7ffec7-0366-43d4-900c-778b7a805002 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:59.258194 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-af7ffec7-0366-43d4-900c-778b7a805002 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:59.258765 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-af7ffec7-0366-43d4-900c-778b7a805002 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:59.334259 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-af7ffec7-0366-43d4-900c-778b7a805002 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:46:59.362649 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-af7ffec7-0366-43d4-900c-778b7a805002 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1308 microversion: 2.1 time: 0.116049 Jun 16 19:46:59.373199 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 246/487] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:46:59 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:46:59.920508 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-618fadb8-f5d5-4497-9a69-fde5daecea4e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:46:59.921864 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-618fadb8-f5d5-4497-9a69-fde5daecea4e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:46:59.931598 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-618fadb8-f5d5-4497-9a69-fde5daecea4e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:59.932143 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-618fadb8-f5d5-4497-9a69-fde5daecea4e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:46:59.933083 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-618fadb8-f5d5-4497-9a69-fde5daecea4e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:46:59.933618 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-618fadb8-f5d5-4497-9a69-fde5daecea4e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:00.096173 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:00.103050 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-618fadb8-f5d5-4497-9a69-fde5daecea4e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lazy-loading 'services' on Instance uuid fa082a59-b1ab-4fee-a88f-4823691ff8e1 {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:47:00.586240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-618fadb8-f5d5-4497-9a69-fde5daecea4e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1/os-volume_attachments/03ae856e-a299-48b9-a246-3f837a1349c9" status: 202 len: 0 microversion: 2.1 time: 0.672499 Jun 16 19:47:00.586862 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 247/488] 10.222.0.36 () {58 vars in 1415 bytes} [Thu Jun 16 19:46:59 2022] DELETE /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1/os-volume_attachments/03ae856e-a299-48b9-a246-3f837a1349c9 => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:47:00.642417 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0eaa8b31-229f-4675-9d02-3c6af651492e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:00.652351 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0eaa8b31-229f-4675-9d02-3c6af651492e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:00.681184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0eaa8b31-229f-4675-9d02-3c6af651492e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:00.681630 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0eaa8b31-229f-4675-9d02-3c6af651492e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:00.684868 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0eaa8b31-229f-4675-9d02-3c6af651492e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:00.685221 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0eaa8b31-229f-4675-9d02-3c6af651492e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:01.066338 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0eaa8b31-229f-4675-9d02-3c6af651492e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:01.076313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0eaa8b31-229f-4675-9d02-3c6af651492e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.468917 Jun 16 19:47:01.082606 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 248/489] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:00 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:01.311654 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:02.047427 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-abf548dc-bfb3-404d-9255-7f4b8f4791a8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "POST /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 3.135775 Jun 16 19:47:02.064756 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 242/490] 10.222.0.36 () {62 vars in 1363 bytes} [Thu Jun 16 19:46:58 2022] POST /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/os-volume_attachments => generated 188 bytes in 3154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:47:02.144095 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=6 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:02.171553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-88af8521-8bb4-461c-802f-d1588d19a767 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:02.172668 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-88af8521-8bb4-461c-802f-d1588d19a767 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:02.200892 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:02.200892 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-88af8521-8bb4-461c-802f-d1588d19a767 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:02.200892 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-88af8521-8bb4-461c-802f-d1588d19a767 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:02.201435 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-88af8521-8bb4-461c-802f-d1588d19a767 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:02.206865 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-88af8521-8bb4-461c-802f-d1588d19a767 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:02.408607 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-978070ec-c164-4a35-a88f-7108ed9427cb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:47:02.410275 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-978070ec-c164-4a35-a88f-7108ed9427cb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:02.426173 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:02.431652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-978070ec-c164-4a35-a88f-7108ed9427cb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:02.432114 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-978070ec-c164-4a35-a88f-7108ed9427cb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:02.435816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-978070ec-c164-4a35-a88f-7108ed9427cb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:02.435816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-978070ec-c164-4a35-a88f-7108ed9427cb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:02.489200 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-88af8521-8bb4-461c-802f-d1588d19a767 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:02.517136 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-88af8521-8bb4-461c-802f-d1588d19a767 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.373928 Jun 16 19:47:02.522142 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 249/491] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:02 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:02.760265 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=8 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:02.827302 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-fe2bbf00-9728-4e41-af07-3e2d942e7f62 req-e8fa4872-6be0-434c-acce-4fc41970109d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf542d63-f9a6-4101-a1a0-be5fff525e1e", "tag": "8b0eb30b-d9a5-4b32-a7b4-cff5a9a46047"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:47:02.838957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-fe2bbf00-9728-4e41-af07-3e2d942e7f62 req-e8fa4872-6be0-434c-acce-4fc41970109d service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:02.840174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-fe2bbf00-9728-4e41-af07-3e2d942e7f62 req-e8fa4872-6be0-434c-acce-4fc41970109d service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:02.866808 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-fe2bbf00-9728-4e41-af07-3e2d942e7f62 req-e8fa4872-6be0-434c-acce-4fc41970109d service nova] Creating event network-changed:8b0eb30b-d9a5-4b32-a7b4-cff5a9a46047 for instance bf542d63-f9a6-4101-a1a0-be5fff525e1e on hv-cinder-84617 Jun 16 19:47:02.881586 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-fe2bbf00-9728-4e41-af07-3e2d942e7f62 req-e8fa4872-6be0-434c-acce-4fc41970109d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058202 Jun 16 19:47:02.883246 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 250/492] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:47:03.076390 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-978070ec-c164-4a35-a88f-7108ed9427cb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "POST /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/action" status: 202 len: 0 microversion: 2.20 time: 0.671413 Jun 16 19:47:03.081232 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 243/493] 10.222.0.36 () {62 vars in 1318 bytes} [Thu Jun 16 19:47:02 2022] POST /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/action => generated 0 bytes in 678 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:47:03.092576 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c8ad4e26-8f4f-4044-b34f-a9ff4de260fa tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:03.093549 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c8ad4e26-8f4f-4044-b34f-a9ff4de260fa tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:03.110345 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c8ad4e26-8f4f-4044-b34f-a9ff4de260fa tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:03.111335 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c8ad4e26-8f4f-4044-b34f-a9ff4de260fa tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:03.121047 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c8ad4e26-8f4f-4044-b34f-a9ff4de260fa tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:03.139044 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c8ad4e26-8f4f-4044-b34f-a9ff4de260fa tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:03.418203 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c8ad4e26-8f4f-4044-b34f-a9ff4de260fa tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:03.434370 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c8ad4e26-8f4f-4044-b34f-a9ff4de260fa tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:03.439984 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c8ad4e26-8f4f-4044-b34f-a9ff4de260fa tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:03.444698 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c8ad4e26-8f4f-4044-b34f-a9ff4de260fa tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1749 microversion: 2.20 time: 0.355697 Jun 16 19:47:03.458762 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 251/494] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:03 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1749 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:03.533537 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9e66f838-1e07-4564-9b83-0658febac045 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:03.534787 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9e66f838-1e07-4564-9b83-0658febac045 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:03.543996 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9e66f838-1e07-4564-9b83-0658febac045 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:03.544851 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9e66f838-1e07-4564-9b83-0658febac045 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:03.552319 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9e66f838-1e07-4564-9b83-0658febac045 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:03.553197 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9e66f838-1e07-4564-9b83-0658febac045 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:03.889695 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9e66f838-1e07-4564-9b83-0658febac045 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:03.897113 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9e66f838-1e07-4564-9b83-0658febac045 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.367656 Jun 16 19:47:03.897670 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 244/495] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:03 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:04.481091 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b3d2a893-ecda-45de-b250-434720abc945 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:04.482687 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b3d2a893-ecda-45de-b250-434720abc945 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:04.491787 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b3d2a893-ecda-45de-b250-434720abc945 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:04.492229 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b3d2a893-ecda-45de-b250-434720abc945 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:04.492995 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b3d2a893-ecda-45de-b250-434720abc945 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:04.493429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b3d2a893-ecda-45de-b250-434720abc945 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:04.695397 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b3d2a893-ecda-45de-b250-434720abc945 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:04.707484 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b3d2a893-ecda-45de-b250-434720abc945 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:04.716434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b3d2a893-ecda-45de-b250-434720abc945 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:04.716434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b3d2a893-ecda-45de-b250-434720abc945 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1749 microversion: 2.20 time: 0.248878 Jun 16 19:47:04.716434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 252/496] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:04 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1749 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:04.914127 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e3ca659f-f1c2-4f79-97d2-8bbc2e6b4e6c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:04.915039 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e3ca659f-f1c2-4f79-97d2-8bbc2e6b4e6c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:04.922736 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e3ca659f-f1c2-4f79-97d2-8bbc2e6b4e6c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:04.923220 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e3ca659f-f1c2-4f79-97d2-8bbc2e6b4e6c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:04.923994 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e3ca659f-f1c2-4f79-97d2-8bbc2e6b4e6c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:04.930481 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e3ca659f-f1c2-4f79-97d2-8bbc2e6b4e6c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:05.087848 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e3ca659f-f1c2-4f79-97d2-8bbc2e6b4e6c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:05.096162 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e3ca659f-f1c2-4f79-97d2-8bbc2e6b4e6c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.185988 Jun 16 19:47:05.099002 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 245/497] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:04 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:05.735197 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bc9a3813-acf5-4465-a32d-4430f6e4921d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:05.735802 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-bc9a3813-acf5-4465-a32d-4430f6e4921d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:05.742119 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bc9a3813-acf5-4465-a32d-4430f6e4921d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:05.742559 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bc9a3813-acf5-4465-a32d-4430f6e4921d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:05.743329 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bc9a3813-acf5-4465-a32d-4430f6e4921d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:05.743756 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bc9a3813-acf5-4465-a32d-4430f6e4921d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:05.877061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-bc9a3813-acf5-4465-a32d-4430f6e4921d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:05.885889 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-bc9a3813-acf5-4465-a32d-4430f6e4921d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:05.887547 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-bc9a3813-acf5-4465-a32d-4430f6e4921d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:05.888742 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-bc9a3813-acf5-4465-a32d-4430f6e4921d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1749 microversion: 2.20 time: 0.157401 Jun 16 19:47:05.889339 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 253/498] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:05 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:06.117276 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3609b07e-5631-482f-b30e-665df0286941 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:06.119201 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3609b07e-5631-482f-b30e-665df0286941 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:06.127209 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3609b07e-5631-482f-b30e-665df0286941 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:06.127633 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3609b07e-5631-482f-b30e-665df0286941 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:06.128403 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3609b07e-5631-482f-b30e-665df0286941 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:06.128836 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3609b07e-5631-482f-b30e-665df0286941 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:06.261142 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3609b07e-5631-482f-b30e-665df0286941 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:06.268786 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3609b07e-5631-482f-b30e-665df0286941 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.155939 Jun 16 19:47:06.269366 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 246/499] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:06 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:06.908873 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c4b90677-8f32-4b2f-ad79-7efcff31e5cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:06.910311 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c4b90677-8f32-4b2f-ad79-7efcff31e5cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:06.929133 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c4b90677-8f32-4b2f-ad79-7efcff31e5cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:06.929764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c4b90677-8f32-4b2f-ad79-7efcff31e5cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:06.931314 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c4b90677-8f32-4b2f-ad79-7efcff31e5cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:06.932143 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c4b90677-8f32-4b2f-ad79-7efcff31e5cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:07.256388 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c4b90677-8f32-4b2f-ad79-7efcff31e5cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:07.265646 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c4b90677-8f32-4b2f-ad79-7efcff31e5cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:07.267455 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c4b90677-8f32-4b2f-ad79-7efcff31e5cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:07.268837 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c4b90677-8f32-4b2f-ad79-7efcff31e5cc tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1749 microversion: 2.20 time: 0.364894 Jun 16 19:47:07.280479 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 254/500] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:06 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1749 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:07.288927 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-92829bda-fe51-4384-8e02-576aaa744ba5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:07.290310 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-92829bda-fe51-4384-8e02-576aaa744ba5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:07.297474 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92829bda-fe51-4384-8e02-576aaa744ba5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:07.298256 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92829bda-fe51-4384-8e02-576aaa744ba5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:07.299305 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92829bda-fe51-4384-8e02-576aaa744ba5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:07.299975 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92829bda-fe51-4384-8e02-576aaa744ba5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:07.556924 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-92829bda-fe51-4384-8e02-576aaa744ba5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:07.566125 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-92829bda-fe51-4384-8e02-576aaa744ba5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.280833 Jun 16 19:47:07.569028 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 247/501] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:07 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:08.290365 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a63fc498-3953-4340-afdd-79b7a601f63c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:08.291219 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a63fc498-3953-4340-afdd-79b7a601f63c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:08.299295 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a63fc498-3953-4340-afdd-79b7a601f63c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:08.300131 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a63fc498-3953-4340-afdd-79b7a601f63c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:08.301150 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a63fc498-3953-4340-afdd-79b7a601f63c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:08.301807 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a63fc498-3953-4340-afdd-79b7a601f63c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:08.515911 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a63fc498-3953-4340-afdd-79b7a601f63c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:08.515911 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a63fc498-3953-4340-afdd-79b7a601f63c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:08.525416 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a63fc498-3953-4340-afdd-79b7a601f63c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:08.529852 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a63fc498-3953-4340-afdd-79b7a601f63c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1749 microversion: 2.20 time: 0.243844 Jun 16 19:47:08.531241 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 255/502] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:08 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1749 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:08.586425 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-258518af-c48a-4801-9fef-369f4f4b40a7 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:08.587074 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-258518af-c48a-4801-9fef-369f4f4b40a7 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:08.596326 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-258518af-c48a-4801-9fef-369f4f4b40a7 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:08.596769 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-258518af-c48a-4801-9fef-369f4f4b40a7 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:08.597542 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-258518af-c48a-4801-9fef-369f4f4b40a7 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:08.597976 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-258518af-c48a-4801-9fef-369f4f4b40a7 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:08.828981 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-258518af-c48a-4801-9fef-369f4f4b40a7 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:08.833112 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:08.838700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-258518af-c48a-4801-9fef-369f4f4b40a7 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.255769 Jun 16 19:47:08.839456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 248/503] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:08 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:09.209357 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-29742b74-79d1-4105-945d-1b2cbb9eb218 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:09.210215 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-29742b74-79d1-4105-945d-1b2cbb9eb218 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:09.218129 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-29742b74-79d1-4105-945d-1b2cbb9eb218 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:09.222685 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-29742b74-79d1-4105-945d-1b2cbb9eb218 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:09.222685 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-29742b74-79d1-4105-945d-1b2cbb9eb218 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:09.222685 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-29742b74-79d1-4105-945d-1b2cbb9eb218 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:09.252441 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-29742b74-79d1-4105-945d-1b2cbb9eb218 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Going to try to terminate instance {{(pid=124551) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:47:09.550855 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2d4006e1-dd19-406f-ace5-27d2af3859ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:09.551447 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2d4006e1-dd19-406f-ace5-27d2af3859ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:09.561553 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2d4006e1-dd19-406f-ace5-27d2af3859ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:09.567689 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2d4006e1-dd19-406f-ace5-27d2af3859ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:09.569210 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2d4006e1-dd19-406f-ace5-27d2af3859ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:09.570018 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2d4006e1-dd19-406f-ace5-27d2af3859ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:09.795808 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-29742b74-79d1-4105-945d-1b2cbb9eb218 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 204 len: 0 microversion: 2.1 time: 0.589699 Jun 16 19:47:09.807591 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 256/504] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:47:09 2022] DELETE /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:47:09.812542 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a1684e32-97dc-4741-a1f9-366113f4aecf tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:09.818286 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2d4006e1-dd19-406f-ace5-27d2af3859ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:09.830764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a1684e32-97dc-4741-a1f9-366113f4aecf tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:09.835026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2d4006e1-dd19-406f-ace5-27d2af3859ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:09.840684 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2d4006e1-dd19-406f-ace5-27d2af3859ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:09.842681 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1684e32-97dc-4741-a1f9-366113f4aecf tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:09.844136 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2d4006e1-dd19-406f-ace5-27d2af3859ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1749 microversion: 2.20 time: 0.297658 Jun 16 19:47:09.844768 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1684e32-97dc-4741-a1f9-366113f4aecf tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:09.857398 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1684e32-97dc-4741-a1f9-366113f4aecf tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:09.857770 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 249/505] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:09 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1749 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:09.862570 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-418c5a63-45f8-4431-a9f3-8c8ad337274f tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:09.863727 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1684e32-97dc-4741-a1f9-366113f4aecf tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:09.870280 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-418c5a63-45f8-4431-a9f3-8c8ad337274f tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:09.881399 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-418c5a63-45f8-4431-a9f3-8c8ad337274f tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:09.881842 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-418c5a63-45f8-4431-a9f3-8c8ad337274f tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:09.889905 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-418c5a63-45f8-4431-a9f3-8c8ad337274f tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:09.890357 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-418c5a63-45f8-4431-a9f3-8c8ad337274f tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:10.119299 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a1684e32-97dc-4741-a1f9-366113f4aecf tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:10.165761 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a1684e32-97dc-4741-a1f9-366113f4aecf tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1559 microversion: 2.1 time: 0.360329 Jun 16 19:47:10.177890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 257/506] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:09 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1559 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:10.186316 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-418c5a63-45f8-4431-a9f3-8c8ad337274f tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:10.197004 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-418c5a63-45f8-4431-a9f3-8c8ad337274f tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.338079 Jun 16 19:47:10.207694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 250/507] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:09 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:10.863937 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-321dd48a-218b-449c-9775-1d0fa8b65fe8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:10.864735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-321dd48a-218b-449c-9775-1d0fa8b65fe8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:10.873928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-321dd48a-218b-449c-9775-1d0fa8b65fe8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:10.877837 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-321dd48a-218b-449c-9775-1d0fa8b65fe8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:10.879056 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-321dd48a-218b-449c-9775-1d0fa8b65fe8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:10.879707 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-321dd48a-218b-449c-9775-1d0fa8b65fe8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:11.071273 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-321dd48a-218b-449c-9775-1d0fa8b65fe8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:11.082075 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-321dd48a-218b-449c-9775-1d0fa8b65fe8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:11.100889 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-321dd48a-218b-449c-9775-1d0fa8b65fe8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:11.103761 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-321dd48a-218b-449c-9775-1d0fa8b65fe8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1749 microversion: 2.20 time: 0.243347 Jun 16 19:47:11.104594 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 258/508] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:10 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1749 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:11.195406 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-090eb324-c331-47c7-8e26-a69ca923a63b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:11.196775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-090eb324-c331-47c7-8e26-a69ca923a63b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:11.216237 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7db62f03-d782-4da7-9c7b-a7150b39f084 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:11.217289 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-7db62f03-d782-4da7-9c7b-a7150b39f084 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:11.225175 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-090eb324-c331-47c7-8e26-a69ca923a63b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:11.226558 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-090eb324-c331-47c7-8e26-a69ca923a63b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:11.229354 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-090eb324-c331-47c7-8e26-a69ca923a63b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:11.230039 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-090eb324-c331-47c7-8e26-a69ca923a63b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:11.230546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7db62f03-d782-4da7-9c7b-a7150b39f084 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:11.232342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7db62f03-d782-4da7-9c7b-a7150b39f084 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:11.234954 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7db62f03-d782-4da7-9c7b-a7150b39f084 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:11.236974 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7db62f03-d782-4da7-9c7b-a7150b39f084 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:11.455352 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-090eb324-c331-47c7-8e26-a69ca923a63b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:11.464972 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-090eb324-c331-47c7-8e26-a69ca923a63b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1559 microversion: 2.1 time: 0.275030 Jun 16 19:47:11.476857 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 251/509] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:11 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1559 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:11.498381 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-7db62f03-d782-4da7-9c7b-a7150b39f084 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:11.525196 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-7db62f03-d782-4da7-9c7b-a7150b39f084 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.315336 Jun 16 19:47:11.533824 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 259/510] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:11 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:12.127184 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2148371f-7ef7-416b-9f63-d55baa6ac893 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:12.128153 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2148371f-7ef7-416b-9f63-d55baa6ac893 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:12.140134 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2148371f-7ef7-416b-9f63-d55baa6ac893 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:12.152961 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2148371f-7ef7-416b-9f63-d55baa6ac893 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:12.152961 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2148371f-7ef7-416b-9f63-d55baa6ac893 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:12.152961 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2148371f-7ef7-416b-9f63-d55baa6ac893 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:12.410833 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2148371f-7ef7-416b-9f63-d55baa6ac893 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:12.420885 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2148371f-7ef7-416b-9f63-d55baa6ac893 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:12.425000 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2148371f-7ef7-416b-9f63-d55baa6ac893 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:12.426601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2148371f-7ef7-416b-9f63-d55baa6ac893 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1749 microversion: 2.20 time: 0.303510 Jun 16 19:47:12.445109 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 252/511] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:12 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1749 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:12.497615 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-63ee5ea1-07db-419d-8b19-f76344f6d80a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:12.505298 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-63ee5ea1-07db-419d-8b19-f76344f6d80a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:12.507506 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-63ee5ea1-07db-419d-8b19-f76344f6d80a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:12.507955 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-63ee5ea1-07db-419d-8b19-f76344f6d80a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:12.508770 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-63ee5ea1-07db-419d-8b19-f76344f6d80a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:12.509226 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-63ee5ea1-07db-419d-8b19-f76344f6d80a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:12.549801 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4d01f5bb-bcb7-4997-8ae7-f189814e1ed2 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:12.550881 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4d01f5bb-bcb7-4997-8ae7-f189814e1ed2 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:12.558520 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4d01f5bb-bcb7-4997-8ae7-f189814e1ed2 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:12.558994 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4d01f5bb-bcb7-4997-8ae7-f189814e1ed2 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:12.559794 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4d01f5bb-bcb7-4997-8ae7-f189814e1ed2 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:12.560405 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4d01f5bb-bcb7-4997-8ae7-f189814e1ed2 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:12.672802 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-63ee5ea1-07db-419d-8b19-f76344f6d80a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:12.683685 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-63ee5ea1-07db-419d-8b19-f76344f6d80a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1559 microversion: 2.1 time: 0.191019 Jun 16 19:47:12.684441 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 260/512] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:12 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:12.735199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4d01f5bb-bcb7-4997-8ae7-f189814e1ed2 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:12.742513 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4d01f5bb-bcb7-4997-8ae7-f189814e1ed2 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.196657 Jun 16 19:47:12.743098 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 253/513] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:12 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:13.445985 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c6dc5f4a-0044-4d15-99db-2c0f27d09139 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:13.446607 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c6dc5f4a-0044-4d15-99db-2c0f27d09139 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:13.452584 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c6dc5f4a-0044-4d15-99db-2c0f27d09139 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:13.456881 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c6dc5f4a-0044-4d15-99db-2c0f27d09139 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:13.456881 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c6dc5f4a-0044-4d15-99db-2c0f27d09139 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:13.456881 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c6dc5f4a-0044-4d15-99db-2c0f27d09139 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:13.579851 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c6dc5f4a-0044-4d15-99db-2c0f27d09139 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:13.588748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c6dc5f4a-0044-4d15-99db-2c0f27d09139 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:13.590239 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c6dc5f4a-0044-4d15-99db-2c0f27d09139 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:13.591438 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c6dc5f4a-0044-4d15-99db-2c0f27d09139 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1749 microversion: 2.20 time: 0.149613 Jun 16 19:47:13.592000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 261/514] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:13 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1749 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:47:13.701101 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-83cd53ef-45b5-49e5-bf87-d81c0545edcc tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:13.701740 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-83cd53ef-45b5-49e5-bf87-d81c0545edcc tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:13.707916 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-83cd53ef-45b5-49e5-bf87-d81c0545edcc tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:13.708448 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-83cd53ef-45b5-49e5-bf87-d81c0545edcc tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:13.709202 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-83cd53ef-45b5-49e5-bf87-d81c0545edcc tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:13.709635 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-83cd53ef-45b5-49e5-bf87-d81c0545edcc tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:13.758660 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0897eba1-ba28-455f-8145-d432590173ee tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:13.759298 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0897eba1-ba28-455f-8145-d432590173ee tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:13.765236 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0897eba1-ba28-455f-8145-d432590173ee tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:13.765687 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0897eba1-ba28-455f-8145-d432590173ee tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:13.767478 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0897eba1-ba28-455f-8145-d432590173ee tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:13.767478 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0897eba1-ba28-455f-8145-d432590173ee tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:13.837595 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-83cd53ef-45b5-49e5-bf87-d81c0545edcc tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:13.846381 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-83cd53ef-45b5-49e5-bf87-d81c0545edcc tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1559 microversion: 2.1 time: 0.149441 Jun 16 19:47:13.847107 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 254/515] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:13 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:13.898906 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0897eba1-ba28-455f-8145-d432590173ee tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:13.904396 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:13.907413 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0897eba1-ba28-455f-8145-d432590173ee tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.152648 Jun 16 19:47:13.907981 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 262/516] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:13 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:14.611284 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-259871cd-6e0e-4fc0-8e2a-04cd1a2808ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:14.612109 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-259871cd-6e0e-4fc0-8e2a-04cd1a2808ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:14.620006 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-259871cd-6e0e-4fc0-8e2a-04cd1a2808ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:14.624661 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-259871cd-6e0e-4fc0-8e2a-04cd1a2808ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:14.626050 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-259871cd-6e0e-4fc0-8e2a-04cd1a2808ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:14.627625 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-259871cd-6e0e-4fc0-8e2a-04cd1a2808ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:14.822264 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-259871cd-6e0e-4fc0-8e2a-04cd1a2808ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:14.840143 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-259871cd-6e0e-4fc0-8e2a-04cd1a2808ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:14.844016 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-259871cd-6e0e-4fc0-8e2a-04cd1a2808ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:14.844423 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-259871cd-6e0e-4fc0-8e2a-04cd1a2808ee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1749 microversion: 2.20 time: 0.237780 Jun 16 19:47:14.849421 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 255/517] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:14 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1749 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:14.864476 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-989c4d7f-a07c-49cf-96aa-a22744dc7abf tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:14.865908 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-989c4d7f-a07c-49cf-96aa-a22744dc7abf tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:14.878287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-989c4d7f-a07c-49cf-96aa-a22744dc7abf tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:14.878750 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-989c4d7f-a07c-49cf-96aa-a22744dc7abf tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:14.879573 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-989c4d7f-a07c-49cf-96aa-a22744dc7abf tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:14.883548 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-989c4d7f-a07c-49cf-96aa-a22744dc7abf tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:14.925998 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4eb778dd-b1b0-4adc-baef-d6e78f0b5dd3 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:14.927239 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4eb778dd-b1b0-4adc-baef-d6e78f0b5dd3 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:14.936361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4eb778dd-b1b0-4adc-baef-d6e78f0b5dd3 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:14.937481 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4eb778dd-b1b0-4adc-baef-d6e78f0b5dd3 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:14.938449 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4eb778dd-b1b0-4adc-baef-d6e78f0b5dd3 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:14.939088 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4eb778dd-b1b0-4adc-baef-d6e78f0b5dd3 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:15.116231 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-989c4d7f-a07c-49cf-96aa-a22744dc7abf tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:15.124119 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-989c4d7f-a07c-49cf-96aa-a22744dc7abf tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1559 microversion: 2.1 time: 0.263787 Jun 16 19:47:15.135132 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 263/518] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:14 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1559 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:15.184626 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4eb778dd-b1b0-4adc-baef-d6e78f0b5dd3 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:15.193444 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4eb778dd-b1b0-4adc-baef-d6e78f0b5dd3 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.271911 Jun 16 19:47:15.203084 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 256/519] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:14 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:15.873852 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c56a9444-4d6f-4403-83c9-1352c0b55b62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:15.880443 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c56a9444-4d6f-4403-83c9-1352c0b55b62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:15.885675 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c56a9444-4d6f-4403-83c9-1352c0b55b62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:15.887515 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c56a9444-4d6f-4403-83c9-1352c0b55b62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:15.888581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c56a9444-4d6f-4403-83c9-1352c0b55b62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:15.889260 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c56a9444-4d6f-4403-83c9-1352c0b55b62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:16.102523 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c56a9444-4d6f-4403-83c9-1352c0b55b62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:16.193555 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c56a9444-4d6f-4403-83c9-1352c0b55b62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:16.193555 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c56a9444-4d6f-4403-83c9-1352c0b55b62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:16.193555 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c56a9444-4d6f-4403-83c9-1352c0b55b62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1749 microversion: 2.20 time: 0.286197 Jun 16 19:47:16.194807 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 264/520] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:15 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1749 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:16.194892 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9435a68f-7a59-479c-a3e9-665860aab7da tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:16.194892 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9435a68f-7a59-479c-a3e9-665860aab7da tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:16.194892 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9435a68f-7a59-479c-a3e9-665860aab7da tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:16.194892 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9435a68f-7a59-479c-a3e9-665860aab7da tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:16.195573 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9435a68f-7a59-479c-a3e9-665860aab7da tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:16.195573 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9435a68f-7a59-479c-a3e9-665860aab7da tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:16.268857 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-191229f9-003c-4cb0-bc00-0243959ae207 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:16.268857 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-191229f9-003c-4cb0-bc00-0243959ae207 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:16.268857 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-191229f9-003c-4cb0-bc00-0243959ae207 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:16.268857 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-191229f9-003c-4cb0-bc00-0243959ae207 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:16.269227 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-191229f9-003c-4cb0-bc00-0243959ae207 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:16.269227 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-191229f9-003c-4cb0-bc00-0243959ae207 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:16.428813 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9435a68f-7a59-479c-a3e9-665860aab7da tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:16.437787 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9435a68f-7a59-479c-a3e9-665860aab7da tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1513 microversion: 2.1 time: 0.276125 Jun 16 19:47:16.439188 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 257/521] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:16 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1513 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:16.567966 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-191229f9-003c-4cb0-bc00-0243959ae207 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:16.580579 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-191229f9-003c-4cb0-bc00-0243959ae207 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.365595 Jun 16 19:47:16.582241 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 265/522] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:16 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:17.174368 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-50efc1ab-a2cb-421b-bef7-8e35f3d607d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:17.175007 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-50efc1ab-a2cb-421b-bef7-8e35f3d607d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:17.182417 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-50efc1ab-a2cb-421b-bef7-8e35f3d607d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:17.182417 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-50efc1ab-a2cb-421b-bef7-8e35f3d607d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:17.182906 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-50efc1ab-a2cb-421b-bef7-8e35f3d607d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:17.183605 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-50efc1ab-a2cb-421b-bef7-8e35f3d607d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:17.446335 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-50efc1ab-a2cb-421b-bef7-8e35f3d607d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:17.458018 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a965f704-154b-444c-b169-5528e2823fc6 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:17.458653 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-50efc1ab-a2cb-421b-bef7-8e35f3d607d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:17.459491 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a965f704-154b-444c-b169-5528e2823fc6 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:17.460074 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-50efc1ab-a2cb-421b-bef7-8e35f3d607d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:17.461342 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-50efc1ab-a2cb-421b-bef7-8e35f3d607d9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1749 microversion: 2.20 time: 0.290875 Jun 16 19:47:17.462268 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 258/523] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:17 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1749 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:17.473845 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a965f704-154b-444c-b169-5528e2823fc6 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:17.473845 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a965f704-154b-444c-b169-5528e2823fc6 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:17.473845 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a965f704-154b-444c-b169-5528e2823fc6 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:17.473845 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a965f704-154b-444c-b169-5528e2823fc6 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:17.602484 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-078ae1a0-b07c-4cea-b932-03b8c0b4970d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:17.607548 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-078ae1a0-b07c-4cea-b932-03b8c0b4970d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:17.622098 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-078ae1a0-b07c-4cea-b932-03b8c0b4970d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:17.624263 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-078ae1a0-b07c-4cea-b932-03b8c0b4970d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:17.627726 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-078ae1a0-b07c-4cea-b932-03b8c0b4970d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:17.628289 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-078ae1a0-b07c-4cea-b932-03b8c0b4970d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:17.648554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a965f704-154b-444c-b169-5528e2823fc6 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:17.675228 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a965f704-154b-444c-b169-5528e2823fc6 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1513 microversion: 2.1 time: 0.221721 Jun 16 19:47:17.682860 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 266/524] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:17 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:18.117289 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-078ae1a0-b07c-4cea-b932-03b8c0b4970d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:18.129037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-078ae1a0-b07c-4cea-b932-03b8c0b4970d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.531364 Jun 16 19:47:18.131447 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 259/525] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:17 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:18.427451 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-28edeb37-fbad-4216-bade-1e7bcca124f7 req-df7607eb-e738-404b-91dd-92db32da7eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa082a59-b1ab-4fee-a88f-4823691ff8e1", "name": "network-vif-deleted", "tag": "545ea0e3-eba0-43e9-9951-d3d05efd1370"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:47:18.435483 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-28edeb37-fbad-4216-bade-1e7bcca124f7 req-df7607eb-e738-404b-91dd-92db32da7eb4 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:18.435918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-28edeb37-fbad-4216-bade-1e7bcca124f7 req-df7607eb-e738-404b-91dd-92db32da7eb4 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:18.446690 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-28edeb37-fbad-4216-bade-1e7bcca124f7 req-df7607eb-e738-404b-91dd-92db32da7eb4 service nova] Creating event network-vif-deleted:545ea0e3-eba0-43e9-9951-d3d05efd1370 for instance fa082a59-b1ab-4fee-a88f-4823691ff8e1 on hv-cinder-84617 Jun 16 19:47:18.452067 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-28edeb37-fbad-4216-bade-1e7bcca124f7 req-df7607eb-e738-404b-91dd-92db32da7eb4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028417 Jun 16 19:47:18.462532 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 267/526] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:47:18.480440 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-eae3d536-f544-476f-a9f3-e08e5df4ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:18.481049 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-eae3d536-f544-476f-a9f3-e08e5df4ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:18.486976 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eae3d536-f544-476f-a9f3-e08e5df4ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:18.487426 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eae3d536-f544-476f-a9f3-e08e5df4ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:18.488181 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eae3d536-f544-476f-a9f3-e08e5df4ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:18.488617 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eae3d536-f544-476f-a9f3-e08e5df4ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:18.633333 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-eae3d536-f544-476f-a9f3-e08e5df4ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:18.647870 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-eae3d536-f544-476f-a9f3-e08e5df4ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:18.649798 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-eae3d536-f544-476f-a9f3-e08e5df4ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:18.654875 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-eae3d536-f544-476f-a9f3-e08e5df4ff34 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1751 microversion: 2.20 time: 0.177984 Jun 16 19:47:18.655431 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 260/527] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:18 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:18.701295 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-120c71f6-f4c6-401e-9f8d-c3efbdb8f3ed tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:18.702290 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-120c71f6-f4c6-401e-9f8d-c3efbdb8f3ed tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:18.709729 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-120c71f6-f4c6-401e-9f8d-c3efbdb8f3ed tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:18.710482 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-120c71f6-f4c6-401e-9f8d-c3efbdb8f3ed tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:18.711459 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-120c71f6-f4c6-401e-9f8d-c3efbdb8f3ed tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:18.711890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-120c71f6-f4c6-401e-9f8d-c3efbdb8f3ed tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:18.781603 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-120c71f6-f4c6-401e-9f8d-c3efbdb8f3ed tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:18.792278 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-120c71f6-f4c6-401e-9f8d-c3efbdb8f3ed tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1471 microversion: 2.1 time: 0.096489 Jun 16 19:47:18.802424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 268/528] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:18 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1471 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:19.148544 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-dc494986-d570-4947-af7c-77a809d647ef tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:19.150057 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-dc494986-d570-4947-af7c-77a809d647ef tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:19.156811 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc494986-d570-4947-af7c-77a809d647ef tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:19.157560 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc494986-d570-4947-af7c-77a809d647ef tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:19.158424 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc494986-d570-4947-af7c-77a809d647ef tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:19.159047 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc494986-d570-4947-af7c-77a809d647ef tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:19.374687 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-dc494986-d570-4947-af7c-77a809d647ef tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:19.383308 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-dc494986-d570-4947-af7c-77a809d647ef tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.238897 Jun 16 19:47:19.394037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 261/529] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:19 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:19.686637 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f0e594ce-55ed-4521-adbe-0e02da21260e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:19.687332 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f0e594ce-55ed-4521-adbe-0e02da21260e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:19.694432 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f0e594ce-55ed-4521-adbe-0e02da21260e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:19.695187 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f0e594ce-55ed-4521-adbe-0e02da21260e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:19.696138 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f0e594ce-55ed-4521-adbe-0e02da21260e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:19.696796 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f0e594ce-55ed-4521-adbe-0e02da21260e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:19.810114 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-72b5eb6d-a8a7-4279-92ba-bea394c8fbc0 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:19.811970 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-72b5eb6d-a8a7-4279-92ba-bea394c8fbc0 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:19.818900 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-72b5eb6d-a8a7-4279-92ba-bea394c8fbc0 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:19.824753 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-72b5eb6d-a8a7-4279-92ba-bea394c8fbc0 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:19.824753 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-72b5eb6d-a8a7-4279-92ba-bea394c8fbc0 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:19.824753 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-72b5eb6d-a8a7-4279-92ba-bea394c8fbc0 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:19.860431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f0e594ce-55ed-4521-adbe-0e02da21260e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:19.875915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f0e594ce-55ed-4521-adbe-0e02da21260e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:19.878686 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f0e594ce-55ed-4521-adbe-0e02da21260e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:19.881063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f0e594ce-55ed-4521-adbe-0e02da21260e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1751 microversion: 2.20 time: 0.198584 Jun 16 19:47:19.883024 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 269/530] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:19 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1751 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:19.921222 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-72b5eb6d-a8a7-4279-92ba-bea394c8fbc0 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:19.932832 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-72b5eb6d-a8a7-4279-92ba-bea394c8fbc0 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1471 microversion: 2.1 time: 0.126999 Jun 16 19:47:19.933719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 262/531] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:19 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1471 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:20.401066 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-eac7af48-428d-4e98-afd2-49c79390802d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:20.401672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-eac7af48-428d-4e98-afd2-49c79390802d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:20.407896 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eac7af48-428d-4e98-afd2-49c79390802d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:20.408343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eac7af48-428d-4e98-afd2-49c79390802d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:20.409187 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eac7af48-428d-4e98-afd2-49c79390802d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:20.409623 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eac7af48-428d-4e98-afd2-49c79390802d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:20.542175 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-eac7af48-428d-4e98-afd2-49c79390802d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:20.549531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-eac7af48-428d-4e98-afd2-49c79390802d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.152361 Jun 16 19:47:20.564448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 270/532] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:20 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:20.900822 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-08af3c19-cecc-42a2-a9df-bda578769f9e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:20.901411 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-08af3c19-cecc-42a2-a9df-bda578769f9e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:20.907937 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-08af3c19-cecc-42a2-a9df-bda578769f9e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:20.908714 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-08af3c19-cecc-42a2-a9df-bda578769f9e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:20.913435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-08af3c19-cecc-42a2-a9df-bda578769f9e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:20.913435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-08af3c19-cecc-42a2-a9df-bda578769f9e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:20.952530 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-ff847a38-9729-4c13-83ed-38cb6f275e21 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:20.953162 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-ff847a38-9729-4c13-83ed-38cb6f275e21 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:20.966642 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ff847a38-9729-4c13-83ed-38cb6f275e21 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:20.967160 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ff847a38-9729-4c13-83ed-38cb6f275e21 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:20.970984 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ff847a38-9729-4c13-83ed-38cb6f275e21 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:20.971443 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ff847a38-9729-4c13-83ed-38cb6f275e21 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:21.082950 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ff847a38-9729-4c13-83ed-38cb6f275e21 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:21.090147 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-ff847a38-9729-4c13-83ed-38cb6f275e21 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1471 microversion: 2.1 time: 0.143191 Jun 16 19:47:21.091239 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 271/533] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:20 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1471 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:21.116459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-08af3c19-cecc-42a2-a9df-bda578769f9e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:21.127811 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-08af3c19-cecc-42a2-a9df-bda578769f9e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:21.129620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-08af3c19-cecc-42a2-a9df-bda578769f9e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:21.131206 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-08af3c19-cecc-42a2-a9df-bda578769f9e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1751 microversion: 2.20 time: 0.234363 Jun 16 19:47:21.143459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 263/534] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:20 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1751 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:21.579734 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-30dbb58d-82db-4e36-81df-6b727a9149df tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:21.580351 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-30dbb58d-82db-4e36-81df-6b727a9149df tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:21.586248 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-30dbb58d-82db-4e36-81df-6b727a9149df tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:21.586706 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-30dbb58d-82db-4e36-81df-6b727a9149df tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:21.587507 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-30dbb58d-82db-4e36-81df-6b727a9149df tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:21.588009 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-30dbb58d-82db-4e36-81df-6b727a9149df tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:21.718915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-30dbb58d-82db-4e36-81df-6b727a9149df tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:21.726391 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-30dbb58d-82db-4e36-81df-6b727a9149df tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.151438 Jun 16 19:47:21.726966 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 272/535] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:21 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:22.109935 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2e8eae32-3351-41ca-8c84-c0f5b79ad1af tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:22.111399 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2e8eae32-3351-41ca-8c84-c0f5b79ad1af tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:22.132869 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e8eae32-3351-41ca-8c84-c0f5b79ad1af tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:22.133401 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e8eae32-3351-41ca-8c84-c0f5b79ad1af tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:22.134265 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e8eae32-3351-41ca-8c84-c0f5b79ad1af tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:22.135339 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e8eae32-3351-41ca-8c84-c0f5b79ad1af tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:22.151791 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-2b28df7f-637a-45cf-81a5-0eb8abc0f3c2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:22.152406 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-2b28df7f-637a-45cf-81a5-0eb8abc0f3c2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:22.165154 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2b28df7f-637a-45cf-81a5-0eb8abc0f3c2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:22.165154 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2b28df7f-637a-45cf-81a5-0eb8abc0f3c2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:22.165154 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2b28df7f-637a-45cf-81a5-0eb8abc0f3c2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:22.165154 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2b28df7f-637a-45cf-81a5-0eb8abc0f3c2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:22.174565 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e8eae32-3351-41ca-8c84-c0f5b79ad1af tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:22.175122 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e8eae32-3351-41ca-8c84-c0f5b79ad1af tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:22.175651 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-2e8eae32-3351-41ca-8c84-c0f5b79ad1af tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lazy-loading 'fault' on Instance uuid fa082a59-b1ab-4fee-a88f-4823691ff8e1 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:47:22.229014 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2e8eae32-3351-41ca-8c84-c0f5b79ad1af tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:22.236577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2e8eae32-3351-41ca-8c84-c0f5b79ad1af tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 200 len: 1308 microversion: 2.1 time: 0.131567 Jun 16 19:47:22.237692 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 264/536] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:22 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 1308 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:22.306902 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-2b28df7f-637a-45cf-81a5-0eb8abc0f3c2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:22.315540 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-2b28df7f-637a-45cf-81a5-0eb8abc0f3c2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:22.317052 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-2b28df7f-637a-45cf-81a5-0eb8abc0f3c2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:22.318196 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-2b28df7f-637a-45cf-81a5-0eb8abc0f3c2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1751 microversion: 2.20 time: 0.170910 Jun 16 19:47:22.319103 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 273/537] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:22 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:47:22.743345 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-14f0403b-10de-4116-bffe-e7ca68d242a7 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:22.743962 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-14f0403b-10de-4116-bffe-e7ca68d242a7 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:22.749702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-14f0403b-10de-4116-bffe-e7ca68d242a7 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:22.750141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-14f0403b-10de-4116-bffe-e7ca68d242a7 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:22.750887 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-14f0403b-10de-4116-bffe-e7ca68d242a7 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:22.751383 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-14f0403b-10de-4116-bffe-e7ca68d242a7 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:22.755153 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:22.899662 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-14f0403b-10de-4116-bffe-e7ca68d242a7 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:22.910558 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-14f0403b-10de-4116-bffe-e7ca68d242a7 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.170251 Jun 16 19:47:22.921347 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 265/538] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:22 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:23.253857 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9974c308-508e-4e14-bcac-36bf014d2e1a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:23.254503 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9974c308-508e-4e14-bcac-36bf014d2e1a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: fa082a59-b1ab-4fee-a88f-4823691ff8e1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:23.263174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9974c308-508e-4e14-bcac-36bf014d2e1a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:23.263629 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9974c308-508e-4e14-bcac-36bf014d2e1a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:23.264452 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9974c308-508e-4e14-bcac-36bf014d2e1a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:23.270785 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9974c308-508e-4e14-bcac-36bf014d2e1a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:23.280256 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-9974c308-508e-4e14-bcac-36bf014d2e1a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] HTTP exception thrown: Instance fa082a59-b1ab-4fee-a88f-4823691ff8e1 could not be found. Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9974c308-508e-4e14-bcac-36bf014d2e1a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Request method failure captured: Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 HTTP/1.1 Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4hilXOgjZ7KEsYHH4dvjvkEaFFD0_QDcF6hjNDsmxOK4VMq2XCWUpWTvPAjR9xWqhptatfZ8PpbHl4h8GF8osNBBi3BWQZ3hw8W2Sf3GusSJrsV9ygn4_OS44rZV-_pfXiQ0EAvDaG4tvx7HwZsXEvQVhHR8YMfC8_3rC46i4UYCZY Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: da06c03197114259aac4bf5444485d51 Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1646040900 Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:47:23.281882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:47:23.283537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da06c03197114259aac4bf5444485d51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/da06c03197114259aac4bf5444485d51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_da06c03197114259aac4bf5444485d51", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da06c03197114259aac4bf5444485d51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:47:23.283537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-VolumesSnapshotTestJSON-1646040900 Jun 16 19:47:23.283537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: da06c03197114259aac4bf5444485d51 Jun 16 19:47:23.283537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1646040900 Jun 16 19:47:23.283537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-VolumesSnapshotTestJSON-1646040900-project Jun 16 19:47:23.283537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:47:23.283537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:47:23.283537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: a7fd310fe0254401b10f6b1517994233 Jun 16 19:47:23.283537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-VolumesSnapshotTestJSON-1646040900-project Jun 16 19:47:23.283537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:47:23.283537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance fa082a59-b1ab-4fee-a88f-4823691ff8e1 could not be found. Jun 16 19:47:23.283537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': 'fa082a59-b1ab-4fee-a88f-4823691ff8e1'} Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa082a59-b1ab-4fee-a88f-4823691ff8e1 could not be found. Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:47:23.287951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:47:23.289174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:47:23.289174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:47:23.289174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:47:23.289174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:47:23.289174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:47:23.289174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:47:23.289174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:47:23.289174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa082a59-b1ab-4fee-a88f-4823691ff8e1 could not be found. Jun 16 19:47:23.289174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:47:23.289174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:47:23.289174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:47:23.289174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:47:23.289174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:47:23.289174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:47:23.289174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:47:23.289174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:47:23.289174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa082a59-b1ab-4fee-a88f-4823691ff8e1 could not be found. Jun 16 19:47:23.289174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:47:23.290280 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9974c308-508e-4e14-bcac-36bf014d2e1a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Returning 404 to user: Instance fa082a59-b1ab-4fee-a88f-4823691ff8e1 could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:47:23.290280 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9974c308-508e-4e14-bcac-36bf014d2e1a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1" status: 404 len: 111 microversion: 2.1 time: 0.033517 Jun 16 19:47:23.290280 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 274/539] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:23 2022] GET /compute/v2.1/servers/fa082a59-b1ab-4fee-a88f-4823691ff8e1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:47:23.338426 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-76ceafde-bee9-44bd-92b3-f7ad8512489a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:23.339100 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-76ceafde-bee9-44bd-92b3-f7ad8512489a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:23.345605 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-76ceafde-bee9-44bd-92b3-f7ad8512489a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:23.346145 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-76ceafde-bee9-44bd-92b3-f7ad8512489a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:23.347088 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-76ceafde-bee9-44bd-92b3-f7ad8512489a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:23.347522 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-76ceafde-bee9-44bd-92b3-f7ad8512489a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:23.485309 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-76ceafde-bee9-44bd-92b3-f7ad8512489a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:23.493823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-76ceafde-bee9-44bd-92b3-f7ad8512489a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:23.495373 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-76ceafde-bee9-44bd-92b3-f7ad8512489a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:23.496510 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-76ceafde-bee9-44bd-92b3-f7ad8512489a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1751 microversion: 2.20 time: 0.162865 Jun 16 19:47:23.497060 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 266/540] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:23 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:23.928074 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-eba50cbf-475c-4d39-abf2-595e09d14914 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:23.928683 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-eba50cbf-475c-4d39-abf2-595e09d14914 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:23.935490 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eba50cbf-475c-4d39-abf2-595e09d14914 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:23.935936 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eba50cbf-475c-4d39-abf2-595e09d14914 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:23.940511 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eba50cbf-475c-4d39-abf2-595e09d14914 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:23.940511 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eba50cbf-475c-4d39-abf2-595e09d14914 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:24.067071 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-eba50cbf-475c-4d39-abf2-595e09d14914 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:24.078227 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-eba50cbf-475c-4d39-abf2-595e09d14914 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.153904 Jun 16 19:47:24.078798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 275/541] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:23 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:24.514745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3c234d48-57e6-4917-900c-d7f5d4535341 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:24.515381 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3c234d48-57e6-4917-900c-d7f5d4535341 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:24.521939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3c234d48-57e6-4917-900c-d7f5d4535341 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:24.522388 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3c234d48-57e6-4917-900c-d7f5d4535341 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:24.523467 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3c234d48-57e6-4917-900c-d7f5d4535341 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:24.523739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3c234d48-57e6-4917-900c-d7f5d4535341 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:24.661409 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3c234d48-57e6-4917-900c-d7f5d4535341 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:24.675152 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3c234d48-57e6-4917-900c-d7f5d4535341 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:24.678214 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3c234d48-57e6-4917-900c-d7f5d4535341 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:24.680464 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3c234d48-57e6-4917-900c-d7f5d4535341 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.169486 Jun 16 19:47:24.681530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 267/542] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:24 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:25.099460 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-396a9931-fdb5-4bb6-b18c-e75fd73c8513 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:25.100102 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-396a9931-fdb5-4bb6-b18c-e75fd73c8513 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:25.107701 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-396a9931-fdb5-4bb6-b18c-e75fd73c8513 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:25.108148 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-396a9931-fdb5-4bb6-b18c-e75fd73c8513 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:25.108924 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-396a9931-fdb5-4bb6-b18c-e75fd73c8513 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:25.109355 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-396a9931-fdb5-4bb6-b18c-e75fd73c8513 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:25.239488 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-396a9931-fdb5-4bb6-b18c-e75fd73c8513 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:25.248432 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-396a9931-fdb5-4bb6-b18c-e75fd73c8513 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.153989 Jun 16 19:47:25.248992 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 276/543] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:25 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:25.700406 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7078d9aa-9346-4136-a876-074179ffcf95 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:25.701013 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7078d9aa-9346-4136-a876-074179ffcf95 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:25.707365 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7078d9aa-9346-4136-a876-074179ffcf95 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:25.707843 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7078d9aa-9346-4136-a876-074179ffcf95 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:25.708609 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7078d9aa-9346-4136-a876-074179ffcf95 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:25.709050 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7078d9aa-9346-4136-a876-074179ffcf95 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:25.838359 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7078d9aa-9346-4136-a876-074179ffcf95 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:25.846799 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7078d9aa-9346-4136-a876-074179ffcf95 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:25.848335 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7078d9aa-9346-4136-a876-074179ffcf95 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:25.851539 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7078d9aa-9346-4136-a876-074179ffcf95 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.153687 Jun 16 19:47:25.851539 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 268/544] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:25 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:26.265177 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-031acb54-ee12-46f5-978d-7e38a8e8b1ab tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:26.265791 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-031acb54-ee12-46f5-978d-7e38a8e8b1ab tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:26.272283 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-031acb54-ee12-46f5-978d-7e38a8e8b1ab tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:26.272727 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-031acb54-ee12-46f5-978d-7e38a8e8b1ab tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:26.273487 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-031acb54-ee12-46f5-978d-7e38a8e8b1ab tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:26.273916 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-031acb54-ee12-46f5-978d-7e38a8e8b1ab tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:26.404489 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-031acb54-ee12-46f5-978d-7e38a8e8b1ab tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:26.412483 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-031acb54-ee12-46f5-978d-7e38a8e8b1ab tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.151178 Jun 16 19:47:26.413060 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 277/545] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:26 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:26.748909 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a7e0c49c-c473-4061-b439-22fcf9d6b27a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:26.749453 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a7e0c49c-c473-4061-b439-22fcf9d6b27a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:26.755428 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a7e0c49c-c473-4061-b439-22fcf9d6b27a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:26.755873 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a7e0c49c-c473-4061-b439-22fcf9d6b27a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:26.756630 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a7e0c49c-c473-4061-b439-22fcf9d6b27a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:26.757063 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a7e0c49c-c473-4061-b439-22fcf9d6b27a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:26.780693 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a7e0c49c-c473-4061-b439-22fcf9d6b27a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc/ips" status: 200 len: 150 microversion: 2.1 time: 0.035591 Jun 16 19:47:26.781264 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 269/546] 10.222.0.36 () {58 vars in 1247 bytes} [Thu Jun 16 19:47:26 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:47:26.794173 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-88bcd440-251c-46d6-97b9-88fe27a4825d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1def8c3b-37e2-495d-ae2f-0caec5f46b31"}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:47:26.795416 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-88bcd440-251c-46d6-97b9-88fe27a4825d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:26.802349 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-88bcd440-251c-46d6-97b9-88fe27a4825d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:26.804038 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-88bcd440-251c-46d6-97b9-88fe27a4825d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:26.804805 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-88bcd440-251c-46d6-97b9-88fe27a4825d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:26.805244 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-88bcd440-251c-46d6-97b9-88fe27a4825d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:26.868544 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-54cd6f95-41ef-4869-9949-08868fd7181c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:26.869713 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-54cd6f95-41ef-4869-9949-08868fd7181c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:26.875834 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54cd6f95-41ef-4869-9949-08868fd7181c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:26.876281 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54cd6f95-41ef-4869-9949-08868fd7181c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:26.877028 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54cd6f95-41ef-4869-9949-08868fd7181c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:26.877526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54cd6f95-41ef-4869-9949-08868fd7181c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:26.886396 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-88bcd440-251c-46d6-97b9-88fe27a4825d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] HTTP exception thrown: Invalid volume: volume 1def8c3b-37e2-495d-ae2f-0caec5f46b31 is already attached to instances: 5c939c84-1712-4551-a3e3-cf42be4113fe Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-88bcd440-251c-46d6-97b9-88fe27a4825d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Request method failure captured: Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: POST /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc/os-volume_attachments HTTP/1.1 Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 74 Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4fyBPW6I9Gw6XK8Mc3wtez0zYsc4UrjgW7z4WtApzgBYkrjjskhl3gYkWnE6yWJE5ICrDHXLgUYO-0AGzBAc7qg6XibMR0r_JEUP5LVfGl7WyQCTm5mkF0v4IWKdbz7Ao2NSIM42ZaaFkj5iXJmRir4voVV15buKmDOb_Ti4CHFnHY Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:47:26.888025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:47:26.898180 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47a4ab888dd74218ab5d7812ad095371", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:47:26.898180 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:47:26.898180 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:47:26.898180 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:47:26.898180 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:47:26.898180 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:47:26.898180 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:47:26.898180 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 4df05cbf303c4524a665b429f240a17a Jun 16 19:47:26.898180 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:47:26.898180 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Jun 16 19:47:26.898180 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {"volumeAttachment": {"volumeId": "1def8c3b-37e2-495d-ae2f-0caec5f46b31"}} Jun 16 19:47:26.898180 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:47:26.899130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Invalid volume: volume 1def8c3b-37e2-495d-ae2f-0caec5f46b31 is already attached to instances: 5c939c84-1712-4551-a3e3-cf42be4113fe Jun 16 19:47:26.899130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'server_id': 'eb16dee5-a334-4d62-8b28-cd5a9632b6cc', 'body': {'volumeAttachment': {'volumeId': '1def8c3b-37e2-495d-ae2f-0caec5f46b31'}}} Jun 16 19:47:26.899130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:47:26.899130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:47:26.899130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 19:47:26.899130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 19:47:26.899130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 19:47:26.899130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:47:26.899130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 19:47:26.899130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 19:47:26.899130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 19:47:26.899130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 19:47:26.899130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 19:47:26.899130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 19:47:26.899130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1def8c3b-37e2-495d-ae2f-0caec5f46b31 is already attached to instances: 5c939c84-1712-4551-a3e3-cf42be4113fe Jun 16 19:47:26.899130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:47:26.899130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:47:26.899130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:47:26.899130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1def8c3b-37e2-495d-ae2f-0caec5f46b31 is already attached to instances: 5c939c84-1712-4551-a3e3-cf42be4113fe Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:47:26.900313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:47:26.901526 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:47:26.901526 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:47:26.901526 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:47:26.901526 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1def8c3b-37e2-495d-ae2f-0caec5f46b31 is already attached to instances: 5c939c84-1712-4551-a3e3-cf42be4113fe Jun 16 19:47:26.901526 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:47:26.901526 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-88bcd440-251c-46d6-97b9-88fe27a4825d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Returning 400 to user: Invalid volume: volume 1def8c3b-37e2-495d-ae2f-0caec5f46b31 is already attached to instances: 5c939c84-1712-4551-a3e3-cf42be4113fe {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:47:26.901526 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-88bcd440-251c-46d6-97b9-88fe27a4825d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "POST /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101729 Jun 16 19:47:26.901526 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 278/547] 10.222.0.36 () {60 vars in 1322 bytes} [Thu Jun 16 19:47:26 2022] POST /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 19:47:26.902017 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b95eca93-1912-4f46-bee3-71a2fdeb9a44 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:26.902017 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b95eca93-1912-4f46-bee3-71a2fdeb9a44 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:26.906812 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b95eca93-1912-4f46-bee3-71a2fdeb9a44 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:26.907393 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b95eca93-1912-4f46-bee3-71a2fdeb9a44 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:26.908162 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b95eca93-1912-4f46-bee3-71a2fdeb9a44 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:26.908598 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b95eca93-1912-4f46-bee3-71a2fdeb9a44 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:26.934487 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b95eca93-1912-4f46-bee3-71a2fdeb9a44 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Going to try to terminate instance {{(pid=124551) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:47:26.967673 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:27.007808 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-54cd6f95-41ef-4869-9949-08868fd7181c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:27.016286 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-54cd6f95-41ef-4869-9949-08868fd7181c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:27.017810 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-54cd6f95-41ef-4869-9949-08868fd7181c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:27.018985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-54cd6f95-41ef-4869-9949-08868fd7181c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.154208 Jun 16 19:47:27.019536 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 270/548] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:26 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:47:27.429904 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e7cecf3a-2e88-42ea-b0a2-89cbe85cbb82 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:27.430513 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e7cecf3a-2e88-42ea-b0a2-89cbe85cbb82 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:27.437037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e7cecf3a-2e88-42ea-b0a2-89cbe85cbb82 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:27.437545 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e7cecf3a-2e88-42ea-b0a2-89cbe85cbb82 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:27.438229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e7cecf3a-2e88-42ea-b0a2-89cbe85cbb82 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:27.438661 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e7cecf3a-2e88-42ea-b0a2-89cbe85cbb82 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:27.464936 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b95eca93-1912-4f46-bee3-71a2fdeb9a44 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "DELETE /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 204 len: 0 microversion: 2.1 time: 0.570206 Jun 16 19:47:27.475870 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 279/549] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:47:26 2022] DELETE /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 19:47:27.475870 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-493b6b4a-2f88-47d3-8560-1fd16a8c2388 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:27.475870 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-493b6b4a-2f88-47d3-8560-1fd16a8c2388 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:27.486972 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-493b6b4a-2f88-47d3-8560-1fd16a8c2388 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:27.487407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-493b6b4a-2f88-47d3-8560-1fd16a8c2388 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:27.488170 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-493b6b4a-2f88-47d3-8560-1fd16a8c2388 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:27.488599 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-493b6b4a-2f88-47d3-8560-1fd16a8c2388 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:27.609145 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e7cecf3a-2e88-42ea-b0a2-89cbe85cbb82 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:27.616825 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e7cecf3a-2e88-42ea-b0a2-89cbe85cbb82 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.190745 Jun 16 19:47:27.617471 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 271/550] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:27 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:27.628745 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-493b6b4a-2f88-47d3-8560-1fd16a8c2388 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:27.636612 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-493b6b4a-2f88-47d3-8560-1fd16a8c2388 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1682 microversion: 2.1 time: 0.166364 Jun 16 19:47:27.637165 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 280/551] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:27 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:28.038034 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6b2b2a98-798a-4521-b60b-3d6baf4fe457 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:28.038729 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6b2b2a98-798a-4521-b60b-3d6baf4fe457 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:28.045375 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6b2b2a98-798a-4521-b60b-3d6baf4fe457 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:28.045819 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6b2b2a98-798a-4521-b60b-3d6baf4fe457 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:28.046569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6b2b2a98-798a-4521-b60b-3d6baf4fe457 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:28.047023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6b2b2a98-798a-4521-b60b-3d6baf4fe457 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:28.177021 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6b2b2a98-798a-4521-b60b-3d6baf4fe457 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:28.185604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6b2b2a98-798a-4521-b60b-3d6baf4fe457 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:28.187121 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6b2b2a98-798a-4521-b60b-3d6baf4fe457 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:28.188276 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6b2b2a98-798a-4521-b60b-3d6baf4fe457 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.154785 Jun 16 19:47:28.188861 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 272/552] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:28 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:28.633762 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b0c8629e-f435-4d51-8fbd-2086f0b0a154 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:28.635034 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b0c8629e-f435-4d51-8fbd-2086f0b0a154 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:28.641848 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b0c8629e-f435-4d51-8fbd-2086f0b0a154 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:28.642291 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b0c8629e-f435-4d51-8fbd-2086f0b0a154 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:28.643071 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b0c8629e-f435-4d51-8fbd-2086f0b0a154 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:28.643503 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b0c8629e-f435-4d51-8fbd-2086f0b0a154 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:28.656701 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-086fc5ec-0e44-4196-9769-eb8620028306 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:28.658625 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-086fc5ec-0e44-4196-9769-eb8620028306 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:28.665246 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-086fc5ec-0e44-4196-9769-eb8620028306 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:28.665721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-086fc5ec-0e44-4196-9769-eb8620028306 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:28.666562 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-086fc5ec-0e44-4196-9769-eb8620028306 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:28.667024 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-086fc5ec-0e44-4196-9769-eb8620028306 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:28.815473 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-086fc5ec-0e44-4196-9769-eb8620028306 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:28.824941 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-086fc5ec-0e44-4196-9769-eb8620028306 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1682 microversion: 2.1 time: 0.172235 Jun 16 19:47:28.828072 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 273/553] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:28 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:28.846147 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b0c8629e-f435-4d51-8fbd-2086f0b0a154 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:28.853492 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b0c8629e-f435-4d51-8fbd-2086f0b0a154 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.223853 Jun 16 19:47:28.854056 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 281/554] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:28 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:29.208116 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-dff2f96e-378c-44dc-abe8-ab405a519f74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:29.208609 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-dff2f96e-378c-44dc-abe8-ab405a519f74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:29.245956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dff2f96e-378c-44dc-abe8-ab405a519f74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:29.245956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dff2f96e-378c-44dc-abe8-ab405a519f74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:29.245956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dff2f96e-378c-44dc-abe8-ab405a519f74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:29.245956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dff2f96e-378c-44dc-abe8-ab405a519f74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:29.499228 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-dff2f96e-378c-44dc-abe8-ab405a519f74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:29.508394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-dff2f96e-378c-44dc-abe8-ab405a519f74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:29.509937 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-dff2f96e-378c-44dc-abe8-ab405a519f74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:29.511135 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-dff2f96e-378c-44dc-abe8-ab405a519f74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.308256 Jun 16 19:47:29.511932 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 274/555] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:29 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:29.821104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-d03a487f-f570-4464-9ef9-6ce28fdf4928 req-08225373-ab83-49c8-ab6d-5c630e697694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf542d63-f9a6-4101-a1a0-be5fff525e1e", "name": "network-vif-plugged", "status": "completed", "tag": "8b0eb30b-d9a5-4b32-a7b4-cff5a9a46047"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:47:29.833243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-d03a487f-f570-4464-9ef9-6ce28fdf4928 req-08225373-ab83-49c8-ab6d-5c630e697694 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:29.833243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-d03a487f-f570-4464-9ef9-6ce28fdf4928 req-08225373-ab83-49c8-ab6d-5c630e697694 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:29.842273 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-33989d82-1b88-4ca5-b738-707abf530397 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:29.842865 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-d03a487f-f570-4464-9ef9-6ce28fdf4928 req-08225373-ab83-49c8-ab6d-5c630e697694 service nova] Creating event network-vif-plugged:8b0eb30b-d9a5-4b32-a7b4-cff5a9a46047 for instance bf542d63-f9a6-4101-a1a0-be5fff525e1e on hv-cinder-84617 Jun 16 19:47:29.843619 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-33989d82-1b88-4ca5-b738-707abf530397 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:29.847867 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-d03a487f-f570-4464-9ef9-6ce28fdf4928 req-08225373-ab83-49c8-ab6d-5c630e697694 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032248 Jun 16 19:47:29.848771 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 282/556] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:47:29.854725 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-33989d82-1b88-4ca5-b738-707abf530397 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:29.855203 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-33989d82-1b88-4ca5-b738-707abf530397 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:29.855993 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-33989d82-1b88-4ca5-b738-707abf530397 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:29.856426 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-33989d82-1b88-4ca5-b738-707abf530397 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:29.872803 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-584081af-3f32-4c32-9b98-b1e2ac047cb5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:29.873613 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-584081af-3f32-4c32-9b98-b1e2ac047cb5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:29.880142 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-584081af-3f32-4c32-9b98-b1e2ac047cb5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:29.880594 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-584081af-3f32-4c32-9b98-b1e2ac047cb5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:29.881420 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-584081af-3f32-4c32-9b98-b1e2ac047cb5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:29.881856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-584081af-3f32-4c32-9b98-b1e2ac047cb5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:30.027313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-584081af-3f32-4c32-9b98-b1e2ac047cb5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:30.035935 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-584081af-3f32-4c32-9b98-b1e2ac047cb5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.167980 Jun 16 19:47:30.037100 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 283/557] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:29 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:30.042389 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7740ed13-01c6-419d-87aa-5b6d003b71f4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "934bcd4e-feb8-42b0-904d-450591281c81"}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:47:30.043752 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-7740ed13-01c6-419d-87aa-5b6d003b71f4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:30.050012 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7740ed13-01c6-419d-87aa-5b6d003b71f4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:30.050763 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7740ed13-01c6-419d-87aa-5b6d003b71f4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:30.051702 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7740ed13-01c6-419d-87aa-5b6d003b71f4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:30.052241 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7740ed13-01c6-419d-87aa-5b6d003b71f4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:30.115277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-33989d82-1b88-4ca5-b738-707abf530397 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:30.126781 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-33989d82-1b88-4ca5-b738-707abf530397 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1682 microversion: 2.1 time: 0.288986 Jun 16 19:47:30.127515 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 275/558] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:29 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1682 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:30.533934 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bcc1a595-7846-42b1-b374-979409b234b7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:30.534564 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-bcc1a595-7846-42b1-b374-979409b234b7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:30.545167 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bcc1a595-7846-42b1-b374-979409b234b7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:30.545616 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bcc1a595-7846-42b1-b374-979409b234b7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:30.546394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bcc1a595-7846-42b1-b374-979409b234b7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:30.547009 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bcc1a595-7846-42b1-b374-979409b234b7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:30.856668 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-bcc1a595-7846-42b1-b374-979409b234b7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:30.867971 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-bcc1a595-7846-42b1-b374-979409b234b7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:30.869660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-bcc1a595-7846-42b1-b374-979409b234b7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:30.870952 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-bcc1a595-7846-42b1-b374-979409b234b7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.343646 Jun 16 19:47:30.871616 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 276/559] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:30 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:47:30.876629 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-2538b73a-1d6f-4bee-aed6-c50d27cc49b8 req-07880907-28f5-45b3-aab4-cb8027cea0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb16dee5-a334-4d62-8b28-cd5a9632b6cc", "name": "network-vif-deleted", "tag": "b303c9b9-b850-4aed-b10c-081efef3620f"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:47:30.887803 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-2538b73a-1d6f-4bee-aed6-c50d27cc49b8 req-07880907-28f5-45b3-aab4-cb8027cea0f9 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:30.888404 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-2538b73a-1d6f-4bee-aed6-c50d27cc49b8 req-07880907-28f5-45b3-aab4-cb8027cea0f9 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:30.902386 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-2538b73a-1d6f-4bee-aed6-c50d27cc49b8 req-07880907-28f5-45b3-aab4-cb8027cea0f9 service nova] Creating event network-vif-deleted:b303c9b9-b850-4aed-b10c-081efef3620f for instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc on hv-cinder-84617 Jun 16 19:47:30.908725 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-2538b73a-1d6f-4bee-aed6-c50d27cc49b8 req-07880907-28f5-45b3-aab4-cb8027cea0f9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035459 Jun 16 19:47:30.909407 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 277/560] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:47:31.054388 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-eedb0b86-b841-4c5a-ae80-bca26dd77c48 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:31.057123 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-eedb0b86-b841-4c5a-ae80-bca26dd77c48 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:31.068407 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eedb0b86-b841-4c5a-ae80-bca26dd77c48 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:31.072366 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eedb0b86-b841-4c5a-ae80-bca26dd77c48 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:31.073502 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eedb0b86-b841-4c5a-ae80-bca26dd77c48 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:31.074414 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eedb0b86-b841-4c5a-ae80-bca26dd77c48 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:31.330058 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-eedb0b86-b841-4c5a-ae80-bca26dd77c48 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:31.341444 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-eedb0b86-b841-4c5a-ae80-bca26dd77c48 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.291171 Jun 16 19:47:31.347089 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 278/561] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:31 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:31.353002 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e01ed363-13c8-4e64-ab90-a9502b64108c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:31.354156 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e01ed363-13c8-4e64-ab90-a9502b64108c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:31.362482 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e01ed363-13c8-4e64-ab90-a9502b64108c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:31.376080 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e01ed363-13c8-4e64-ab90-a9502b64108c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:31.380280 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e01ed363-13c8-4e64-ab90-a9502b64108c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:31.380280 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e01ed363-13c8-4e64-ab90-a9502b64108c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:31.481930 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e01ed363-13c8-4e64-ab90-a9502b64108c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:31.490260 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e01ed363-13c8-4e64-ab90-a9502b64108c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1614 microversion: 2.1 time: 0.146098 Jun 16 19:47:31.490840 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 279/562] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:31 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1614 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:31.699916 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-7740ed13-01c6-419d-87aa-5b6d003b71f4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "POST /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.661404 Jun 16 19:47:31.700599 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 284/563] 10.222.0.36 () {60 vars in 1322 bytes} [Thu Jun 16 19:47:30 2022] POST /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/os-volume_attachments => generated 194 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:47:31.891469 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fcf44d3f-2427-4ba8-a9aa-04aeb9dc72e7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:31.892081 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fcf44d3f-2427-4ba8-a9aa-04aeb9dc72e7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:31.898204 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fcf44d3f-2427-4ba8-a9aa-04aeb9dc72e7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:31.898648 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fcf44d3f-2427-4ba8-a9aa-04aeb9dc72e7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:31.899451 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fcf44d3f-2427-4ba8-a9aa-04aeb9dc72e7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:31.900443 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fcf44d3f-2427-4ba8-a9aa-04aeb9dc72e7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:32.061808 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fcf44d3f-2427-4ba8-a9aa-04aeb9dc72e7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:32.094957 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fcf44d3f-2427-4ba8-a9aa-04aeb9dc72e7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:32.097421 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fcf44d3f-2427-4ba8-a9aa-04aeb9dc72e7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:32.099189 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fcf44d3f-2427-4ba8-a9aa-04aeb9dc72e7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.211437 Jun 16 19:47:32.100278 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 280/564] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:31 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:32.365577 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-369548d4-eb00-4e6c-817f-733017e7be0e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:32.366312 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-369548d4-eb00-4e6c-817f-733017e7be0e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:32.373417 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-369548d4-eb00-4e6c-817f-733017e7be0e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:32.373871 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-369548d4-eb00-4e6c-817f-733017e7be0e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:32.374650 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-369548d4-eb00-4e6c-817f-733017e7be0e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:32.375136 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-369548d4-eb00-4e6c-817f-733017e7be0e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:32.511297 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-19404136-0ad3-46f9-b912-c58644b9fa3a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:32.512270 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-19404136-0ad3-46f9-b912-c58644b9fa3a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:32.519758 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-19404136-0ad3-46f9-b912-c58644b9fa3a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:32.520682 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-19404136-0ad3-46f9-b912-c58644b9fa3a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:32.521778 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-19404136-0ad3-46f9-b912-c58644b9fa3a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:32.522386 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-19404136-0ad3-46f9-b912-c58644b9fa3a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:32.538703 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-369548d4-eb00-4e6c-817f-733017e7be0e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:32.547215 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-369548d4-eb00-4e6c-817f-733017e7be0e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.186902 Jun 16 19:47:32.557824 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 285/565] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:32 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:32.603950 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-19404136-0ad3-46f9-b912-c58644b9fa3a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:32.609918 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-19404136-0ad3-46f9-b912-c58644b9fa3a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1614 microversion: 2.1 time: 0.105502 Jun 16 19:47:32.610513 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 281/566] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:32 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1614 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:33.117994 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-04af2a9b-76fb-4236-9153-702b9e13d606 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:33.118771 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-04af2a9b-76fb-4236-9153-702b9e13d606 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:33.125985 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-04af2a9b-76fb-4236-9153-702b9e13d606 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:33.126680 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-04af2a9b-76fb-4236-9153-702b9e13d606 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:33.127484 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-04af2a9b-76fb-4236-9153-702b9e13d606 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:33.127982 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-04af2a9b-76fb-4236-9153-702b9e13d606 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:33.274639 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-04af2a9b-76fb-4236-9153-702b9e13d606 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:33.283537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-04af2a9b-76fb-4236-9153-702b9e13d606 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:33.286537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-04af2a9b-76fb-4236-9153-702b9e13d606 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:33.286537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-04af2a9b-76fb-4236-9153-702b9e13d606 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.172464 Jun 16 19:47:33.287126 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 286/567] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:33 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:33.573849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ad2361f8-abbc-4b9d-b3c1-4eb826a3413e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:33.574461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ad2361f8-abbc-4b9d-b3c1-4eb826a3413e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:33.580381 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad2361f8-abbc-4b9d-b3c1-4eb826a3413e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:33.580827 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad2361f8-abbc-4b9d-b3c1-4eb826a3413e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:33.581582 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad2361f8-abbc-4b9d-b3c1-4eb826a3413e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:33.582011 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad2361f8-abbc-4b9d-b3c1-4eb826a3413e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:33.627664 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-4e9a2731-9249-4e46-ab36-da2ab25917f0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:33.628511 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-4e9a2731-9249-4e46-ab36-da2ab25917f0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:33.636112 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4e9a2731-9249-4e46-ab36-da2ab25917f0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:33.636571 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4e9a2731-9249-4e46-ab36-da2ab25917f0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:33.637339 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4e9a2731-9249-4e46-ab36-da2ab25917f0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:33.637783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4e9a2731-9249-4e46-ab36-da2ab25917f0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:33.707195 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-4e9a2731-9249-4e46-ab36-da2ab25917f0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:33.714737 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ad2361f8-abbc-4b9d-b3c1-4eb826a3413e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:33.719355 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:33.722960 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-4e9a2731-9249-4e46-ab36-da2ab25917f0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1614 microversion: 2.1 time: 0.099320 Jun 16 19:47:33.723744 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 287/568] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:33 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1614 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:33.737447 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ad2361f8-abbc-4b9d-b3c1-4eb826a3413e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.156566 Jun 16 19:47:33.737447 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 282/569] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:33 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:34.304998 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-44929649-be89-445e-aed3-1faf2ea0f4cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:34.305600 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-44929649-be89-445e-aed3-1faf2ea0f4cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:34.312268 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-44929649-be89-445e-aed3-1faf2ea0f4cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:34.312722 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-44929649-be89-445e-aed3-1faf2ea0f4cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:34.313698 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-44929649-be89-445e-aed3-1faf2ea0f4cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:34.314052 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-44929649-be89-445e-aed3-1faf2ea0f4cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:34.463066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-44929649-be89-445e-aed3-1faf2ea0f4cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:34.474603 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-44929649-be89-445e-aed3-1faf2ea0f4cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:34.476150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-44929649-be89-445e-aed3-1faf2ea0f4cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:34.477902 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-44929649-be89-445e-aed3-1faf2ea0f4cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.176790 Jun 16 19:47:34.483860 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 283/570] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:34 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:34.742996 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bb39344a-85a6-4460-b450-015a75230e90 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:34.744248 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-bb39344a-85a6-4460-b450-015a75230e90 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:34.744859 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f0119502-27b3-4035-a2d8-5241b71934f8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:34.745473 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f0119502-27b3-4035-a2d8-5241b71934f8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:34.750724 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bb39344a-85a6-4460-b450-015a75230e90 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:34.751206 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bb39344a-85a6-4460-b450-015a75230e90 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:34.751438 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f0119502-27b3-4035-a2d8-5241b71934f8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:34.751889 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f0119502-27b3-4035-a2d8-5241b71934f8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:34.751998 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bb39344a-85a6-4460-b450-015a75230e90 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:34.752398 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bb39344a-85a6-4460-b450-015a75230e90 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:34.752646 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f0119502-27b3-4035-a2d8-5241b71934f8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:34.753094 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f0119502-27b3-4035-a2d8-5241b71934f8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:34.835666 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f0119502-27b3-4035-a2d8-5241b71934f8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:34.844275 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f0119502-27b3-4035-a2d8-5241b71934f8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1614 microversion: 2.1 time: 0.103643 Jun 16 19:47:34.845212 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 284/571] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:34 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1614 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:34.964971 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-bb39344a-85a6-4460-b450-015a75230e90 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:34.975327 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-bb39344a-85a6-4460-b450-015a75230e90 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.234462 Jun 16 19:47:34.976112 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 288/572] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:34 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:35.036582 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-238e54f9-70cd-4007-88d6-3a9469a88418 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1955608783", "imageRef": "9fcb2be6-02db-4853-a8d6-6478a75f26a3", "flavorRef": "452", "networks": [{"uuid": "ca802f06-7183-4201-a7b3-b1df08f868d7"}]}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:47:35.112547 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-238e54f9-70cd-4007-88d6-3a9469a88418 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] validate_networks() for [('ca802f06-7183-4201-a7b3-b1df08f868d7', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:47:35.501608 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-09277e09-fe89-458f-bf2f-013ee647e8b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:35.502260 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-09277e09-fe89-458f-bf2f-013ee647e8b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:35.514024 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-09277e09-fe89-458f-bf2f-013ee647e8b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:35.514743 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-09277e09-fe89-458f-bf2f-013ee647e8b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:35.515716 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-09277e09-fe89-458f-bf2f-013ee647e8b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:35.516144 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-09277e09-fe89-458f-bf2f-013ee647e8b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:35.662771 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-09277e09-fe89-458f-bf2f-013ee647e8b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:35.678823 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-09277e09-fe89-458f-bf2f-013ee647e8b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:35.678823 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-09277e09-fe89-458f-bf2f-013ee647e8b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:35.678823 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-09277e09-fe89-458f-bf2f-013ee647e8b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.183369 Jun 16 19:47:35.687395 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 289/573] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:35 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:47:35.808750 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-238e54f9-70cd-4007-88d6-3a9469a88418 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:47:35.809292 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-238e54f9-70cd-4007-88d6-3a9469a88418 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:47:35.809750 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-238e54f9-70cd-4007-88d6-3a9469a88418 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:47:35.810177 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-238e54f9-70cd-4007-88d6-3a9469a88418 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:47:35.812355 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-238e54f9-70cd-4007-88d6-3a9469a88418 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:47:35.826226 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-238e54f9-70cd-4007-88d6-3a9469a88418 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:35.826864 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-238e54f9-70cd-4007-88d6-3a9469a88418 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:35.827497 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-238e54f9-70cd-4007-88d6-3a9469a88418 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:35.827931 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-238e54f9-70cd-4007-88d6-3a9469a88418 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:35.853176 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-238e54f9-70cd-4007-88d6-3a9469a88418 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Getting quotas for project da06c03197114259aac4bf5444485d51. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:47:35.857951 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-238e54f9-70cd-4007-88d6-3a9469a88418 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Getting quotas for user a7fd310fe0254401b10f6b1517994233 and project da06c03197114259aac4bf5444485d51. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:47:35.865884 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7133e146-1c26-496a-9fd8-bf9a350a3d60 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:35.867214 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-7133e146-1c26-496a-9fd8-bf9a350a3d60 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:35.875784 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7133e146-1c26-496a-9fd8-bf9a350a3d60 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:35.876522 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7133e146-1c26-496a-9fd8-bf9a350a3d60 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:35.877474 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7133e146-1c26-496a-9fd8-bf9a350a3d60 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:35.878550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7133e146-1c26-496a-9fd8-bf9a350a3d60 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:35.888585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-238e54f9-70cd-4007-88d6-3a9469a88418 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:47:35.895563 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-238e54f9-70cd-4007-88d6-3a9469a88418 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcb2be6-02db-4853-a8d6-6478a75f26a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:47:35.916424 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:35.958540 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-7133e146-1c26-496a-9fd8-bf9a350a3d60 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:35.967557 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-7133e146-1c26-496a-9fd8-bf9a350a3d60 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1614 microversion: 2.1 time: 0.105486 Jun 16 19:47:35.968224 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 290/574] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:35 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1614 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:35.995788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-ce86a817-5d08-4bc7-9c6c-d605158c3858 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:35.996631 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-ce86a817-5d08-4bc7-9c6c-d605158c3858 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:36.003915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ce86a817-5d08-4bc7-9c6c-d605158c3858 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:36.004912 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ce86a817-5d08-4bc7-9c6c-d605158c3858 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:36.006175 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ce86a817-5d08-4bc7-9c6c-d605158c3858 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:36.006949 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ce86a817-5d08-4bc7-9c6c-d605158c3858 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:36.071350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-238e54f9-70cd-4007-88d6-3a9469a88418 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.039379 Jun 16 19:47:36.074415 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 285/575] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:47:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:47:36.082306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b2e884f4-7db0-4642-899d-8388dba02ce2 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:36.083099 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b2e884f4-7db0-4642-899d-8388dba02ce2 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:36.196112 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b2e884f4-7db0-4642-899d-8388dba02ce2 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:36.205324 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b2e884f4-7db0-4642-899d-8388dba02ce2 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1219 microversion: 2.1 time: 0.124895 Jun 16 19:47:36.207454 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 286/576] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:36 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1219 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:36.247559 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ce86a817-5d08-4bc7-9c6c-d605158c3858 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:36.268028 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-ce86a817-5d08-4bc7-9c6c-d605158c3858 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.272396 Jun 16 19:47:36.268028 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 291/577] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:35 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:36.312624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0d5b4306-daf5-4ddb-97b0-62fb67c5daaf tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-758831914", "imageRef": "9fcb2be6-02db-4853-a8d6-6478a75f26a3", "flavorRef": "452"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:47:36.706032 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8536ff93-3e87-4f13-9a34-f74fb97798ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:36.706032 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8536ff93-3e87-4f13-9a34-f74fb97798ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:36.707730 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8536ff93-3e87-4f13-9a34-f74fb97798ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:36.708639 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8536ff93-3e87-4f13-9a34-f74fb97798ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:36.709815 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8536ff93-3e87-4f13-9a34-f74fb97798ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:36.711036 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8536ff93-3e87-4f13-9a34-f74fb97798ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:36.932052 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8536ff93-3e87-4f13-9a34-f74fb97798ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:36.942386 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8536ff93-3e87-4f13-9a34-f74fb97798ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:36.945143 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8536ff93-3e87-4f13-9a34-f74fb97798ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:36.947346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8536ff93-3e87-4f13-9a34-f74fb97798ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.255414 Jun 16 19:47:36.959307 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 292/578] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:36 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:36.986400 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-2f4228a2-11e7-420f-a9c2-26c5510e8213 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:36.998338 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-2f4228a2-11e7-420f-a9c2-26c5510e8213 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:36.998338 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:37.016753 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2f4228a2-11e7-420f-a9c2-26c5510e8213 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:37.017197 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2f4228a2-11e7-420f-a9c2-26c5510e8213 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:37.018100 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2f4228a2-11e7-420f-a9c2-26c5510e8213 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:37.018699 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2f4228a2-11e7-420f-a9c2-26c5510e8213 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:37.103022 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-2f4228a2-11e7-420f-a9c2-26c5510e8213 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:37.112360 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-2f4228a2-11e7-420f-a9c2-26c5510e8213 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1326 microversion: 2.1 time: 0.129737 Jun 16 19:47:37.112893 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 293/579] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:36 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1326 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:37.224540 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6bf085e5-a8da-4d1d-8fca-32a1c4bda547 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:37.227377 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6bf085e5-a8da-4d1d-8fca-32a1c4bda547 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:37.335978 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6bf085e5-a8da-4d1d-8fca-32a1c4bda547 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:37.345111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6bf085e5-a8da-4d1d-8fca-32a1c4bda547 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1219 microversion: 2.1 time: 0.124760 Jun 16 19:47:37.347893 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 294/580] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:37 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1219 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:37.351940 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-21853d26-5ca6-448c-b705-f4459152013d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:37.352680 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-21853d26-5ca6-448c-b705-f4459152013d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:37.376776 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-21853d26-5ca6-448c-b705-f4459152013d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:37.377225 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-21853d26-5ca6-448c-b705-f4459152013d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:37.378089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-21853d26-5ca6-448c-b705-f4459152013d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:37.378536 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-21853d26-5ca6-448c-b705-f4459152013d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:37.809269 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-21853d26-5ca6-448c-b705-f4459152013d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:37.817929 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-21853d26-5ca6-448c-b705-f4459152013d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1356 microversion: 2.1 time: 0.470680 Jun 16 19:47:37.837989 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 295/581] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:37 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1356 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:37.967398 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-fe84cbde-ba92-4401-9b66-0bc3a4f8318c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:37.968930 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-fe84cbde-ba92-4401-9b66-0bc3a4f8318c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:37.982529 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fe84cbde-ba92-4401-9b66-0bc3a4f8318c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:37.983268 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fe84cbde-ba92-4401-9b66-0bc3a4f8318c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:37.984801 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fe84cbde-ba92-4401-9b66-0bc3a4f8318c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:37.985407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fe84cbde-ba92-4401-9b66-0bc3a4f8318c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:37.990508 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:38.188716 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-fe84cbde-ba92-4401-9b66-0bc3a4f8318c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:38.206178 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-fe84cbde-ba92-4401-9b66-0bc3a4f8318c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:38.208232 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-fe84cbde-ba92-4401-9b66-0bc3a4f8318c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:38.210509 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-fe84cbde-ba92-4401-9b66-0bc3a4f8318c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.248125 Jun 16 19:47:38.211149 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 296/582] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:37 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:38.229047 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5d94c040-1c22-4b39-9fbe-272cd1c5963d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:38.230034 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5d94c040-1c22-4b39-9fbe-272cd1c5963d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:38.237003 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d94c040-1c22-4b39-9fbe-272cd1c5963d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:38.237467 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d94c040-1c22-4b39-9fbe-272cd1c5963d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:38.238254 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d94c040-1c22-4b39-9fbe-272cd1c5963d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:38.238732 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d94c040-1c22-4b39-9fbe-272cd1c5963d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:38.311597 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5d94c040-1c22-4b39-9fbe-272cd1c5963d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:38.326102 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5d94c040-1c22-4b39-9fbe-272cd1c5963d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1326 microversion: 2.1 time: 0.113640 Jun 16 19:47:38.327056 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 297/583] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:38 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1326 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:38.363419 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9c710eb8-caaa-477e-8ff2-9426794128f0 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:38.364220 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9c710eb8-caaa-477e-8ff2-9426794128f0 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:38.377277 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9c710eb8-caaa-477e-8ff2-9426794128f0 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:38.378147 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9c710eb8-caaa-477e-8ff2-9426794128f0 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:38.379503 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9c710eb8-caaa-477e-8ff2-9426794128f0 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:38.380168 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9c710eb8-caaa-477e-8ff2-9426794128f0 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:38.453969 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9c710eb8-caaa-477e-8ff2-9426794128f0 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:38.466038 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9c710eb8-caaa-477e-8ff2-9426794128f0 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1223 microversion: 2.1 time: 0.106916 Jun 16 19:47:38.466992 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 298/584] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:38 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:38.836550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e6e73465-4ccc-4703-bc3c-ee841c3f9361 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:38.837175 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e6e73465-4ccc-4703-bc3c-ee841c3f9361 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:38.843422 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e6e73465-4ccc-4703-bc3c-ee841c3f9361 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:38.843853 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e6e73465-4ccc-4703-bc3c-ee841c3f9361 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:38.844832 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e6e73465-4ccc-4703-bc3c-ee841c3f9361 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:38.845261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e6e73465-4ccc-4703-bc3c-ee841c3f9361 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:39.024425 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e6e73465-4ccc-4703-bc3c-ee841c3f9361 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:39.036559 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e6e73465-4ccc-4703-bc3c-ee841c3f9361 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1546 microversion: 2.1 time: 0.204272 Jun 16 19:47:39.037322 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 299/585] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:38 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1546 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:39.056636 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d46ea110-b91b-4d9c-abef-4a5cd5c8afc5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:39.057460 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d46ea110-b91b-4d9c-abef-4a5cd5c8afc5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:39.065066 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d46ea110-b91b-4d9c-abef-4a5cd5c8afc5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:39.065639 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d46ea110-b91b-4d9c-abef-4a5cd5c8afc5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:39.066604 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d46ea110-b91b-4d9c-abef-4a5cd5c8afc5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:39.067136 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d46ea110-b91b-4d9c-abef-4a5cd5c8afc5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:39.218834 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d46ea110-b91b-4d9c-abef-4a5cd5c8afc5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:39.227078 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d46ea110-b91b-4d9c-abef-4a5cd5c8afc5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1546 microversion: 2.1 time: 0.175014 Jun 16 19:47:39.228335 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 300/586] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:39 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1546 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:39.233692 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d185b88a-4a07-4d99-ad1c-5a56598b49bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:39.236778 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d185b88a-4a07-4d99-ad1c-5a56598b49bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:39.241364 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d185b88a-4a07-4d99-ad1c-5a56598b49bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:39.241818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d185b88a-4a07-4d99-ad1c-5a56598b49bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:39.242591 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d185b88a-4a07-4d99-ad1c-5a56598b49bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:39.243073 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d185b88a-4a07-4d99-ad1c-5a56598b49bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:39.407968 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d185b88a-4a07-4d99-ad1c-5a56598b49bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:39.435458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d185b88a-4a07-4d99-ad1c-5a56598b49bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:39.435458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d185b88a-4a07-4d99-ad1c-5a56598b49bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:39.435458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d185b88a-4a07-4d99-ad1c-5a56598b49bf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.194781 Jun 16 19:47:39.435731 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 301/587] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:39 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:39.435731 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1f295756-25f6-4699-9802-938d8a2c5b09 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:39.435731 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1f295756-25f6-4699-9802-938d8a2c5b09 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:39.435731 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-1f295756-25f6-4699-9802-938d8a2c5b09 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Searching by: {'deleted': False, 'project_id': '2ab754ce6b844222af7ddb23f93aa648'} {{(pid=124551) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 19:47:39.442509 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1f295756-25f6-4699-9802-938d8a2c5b09 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:39.443155 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1f295756-25f6-4699-9802-938d8a2c5b09 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:39.444283 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1f295756-25f6-4699-9802-938d8a2c5b09 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:39.444839 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1f295756-25f6-4699-9802-938d8a2c5b09 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:39.572275 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.multi_cell_list [None req-1f295756-25f6-4699-9802-938d8a2c5b09 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124551) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 19:47:39.688390 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-1f295756-25f6-4699-9802-938d8a2c5b09 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.262073 Jun 16 19:47:39.689225 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 302/588] 10.222.0.36 () {58 vars in 1124 bytes} [Thu Jun 16 19:47:39 2022] GET /compute/v2.1/servers => generated 341 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:47:39.704438 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9171f60d-c673-4fd5-a6df-1837cfc719e8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:39.705075 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9171f60d-c673-4fd5-a6df-1837cfc719e8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:39.712382 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9171f60d-c673-4fd5-a6df-1837cfc719e8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:39.712864 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9171f60d-c673-4fd5-a6df-1837cfc719e8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:39.713765 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9171f60d-c673-4fd5-a6df-1837cfc719e8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:39.714148 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9171f60d-c673-4fd5-a6df-1837cfc719e8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:39.751220 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9171f60d-c673-4fd5-a6df-1837cfc719e8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:39.751672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9171f60d-c673-4fd5-a6df-1837cfc719e8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:39.752121 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-9171f60d-c673-4fd5-a6df-1837cfc719e8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lazy-loading 'fault' on Instance uuid eb16dee5-a334-4d62-8b28-cd5a9632b6cc {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:47:39.804877 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9171f60d-c673-4fd5-a6df-1837cfc719e8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:39.813858 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9171f60d-c673-4fd5-a6df-1837cfc719e8 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1331 microversion: 2.1 time: 0.117353 Jun 16 19:47:39.814556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 303/589] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:39 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1331 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:39.820957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c189c62c-dacf-43b0-8888-292d134eda35 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:39.821693 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c189c62c-dacf-43b0-8888-292d134eda35 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:39.827949 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c189c62c-dacf-43b0-8888-292d134eda35 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:39.828576 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c189c62c-dacf-43b0-8888-292d134eda35 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:39.830011 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c189c62c-dacf-43b0-8888-292d134eda35 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:39.830569 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c189c62c-dacf-43b0-8888-292d134eda35 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:39.901124 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c189c62c-dacf-43b0-8888-292d134eda35 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:39.909658 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c189c62c-dacf-43b0-8888-292d134eda35 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1223 microversion: 2.1 time: 0.093929 Jun 16 19:47:39.910269 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 304/590] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:39 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:39.915123 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d7f365d8-a24b-464a-ad80-be0c3000cc9c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:39.915766 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d7f365d8-a24b-464a-ad80-be0c3000cc9c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:39.924388 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d7f365d8-a24b-464a-ad80-be0c3000cc9c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:39.924836 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d7f365d8-a24b-464a-ad80-be0c3000cc9c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:39.925597 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d7f365d8-a24b-464a-ad80-be0c3000cc9c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:39.926028 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d7f365d8-a24b-464a-ad80-be0c3000cc9c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:40.084974 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d7f365d8-a24b-464a-ad80-be0c3000cc9c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:40.093867 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d7f365d8-a24b-464a-ad80-be0c3000cc9c tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1546 microversion: 2.1 time: 0.182470 Jun 16 19:47:40.094425 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 305/591] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:39 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1546 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:40.445516 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9d948567-aab3-47cf-9eb4-cca22b581f77 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:40.446217 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9d948567-aab3-47cf-9eb4-cca22b581f77 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:40.455400 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9d948567-aab3-47cf-9eb4-cca22b581f77 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:40.455966 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9d948567-aab3-47cf-9eb4-cca22b581f77 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:40.457629 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9d948567-aab3-47cf-9eb4-cca22b581f77 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:40.457629 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9d948567-aab3-47cf-9eb4-cca22b581f77 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:40.729817 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9d948567-aab3-47cf-9eb4-cca22b581f77 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:40.741484 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9d948567-aab3-47cf-9eb4-cca22b581f77 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:40.743784 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9d948567-aab3-47cf-9eb4-cca22b581f77 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:40.744983 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9d948567-aab3-47cf-9eb4-cca22b581f77 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.305075 Jun 16 19:47:40.749027 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 306/592] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:40 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:47:40.831567 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0096ff9e-baf4-46a7-b10e-70c0f6287e72 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:40.832670 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0096ff9e-baf4-46a7-b10e-70c0f6287e72 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:40.861455 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0096ff9e-baf4-46a7-b10e-70c0f6287e72 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:40.864572 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0096ff9e-baf4-46a7-b10e-70c0f6287e72 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:40.865582 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0096ff9e-baf4-46a7-b10e-70c0f6287e72 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:40.866070 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0096ff9e-baf4-46a7-b10e-70c0f6287e72 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:40.913022 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0096ff9e-baf4-46a7-b10e-70c0f6287e72 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:40.913239 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0096ff9e-baf4-46a7-b10e-70c0f6287e72 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:40.913983 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-0096ff9e-baf4-46a7-b10e-70c0f6287e72 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lazy-loading 'fault' on Instance uuid eb16dee5-a334-4d62-8b28-cd5a9632b6cc {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:47:40.968199 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0096ff9e-baf4-46a7-b10e-70c0f6287e72 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:40.976044 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0096ff9e-baf4-46a7-b10e-70c0f6287e72 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1331 microversion: 2.1 time: 0.148374 Jun 16 19:47:40.988378 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 307/593] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:40 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1331 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:41.011170 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1342cb43-2e1a-4d95-b780-4c69fda8f57f tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:41.011170 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-1342cb43-2e1a-4d95-b780-4c69fda8f57f tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:41.011170 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1342cb43-2e1a-4d95-b780-4c69fda8f57f tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:41.011170 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1342cb43-2e1a-4d95-b780-4c69fda8f57f tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:41.011623 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1342cb43-2e1a-4d95-b780-4c69fda8f57f tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:41.011623 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1342cb43-2e1a-4d95-b780-4c69fda8f57f tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:41.100603 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1342cb43-2e1a-4d95-b780-4c69fda8f57f tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:41.108356 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-1342cb43-2e1a-4d95-b780-4c69fda8f57f tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1215 microversion: 2.1 time: 0.117470 Jun 16 19:47:41.108924 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 308/594] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:40 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:41.770015 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-ab668c39-b65a-4da4-84e4-cb96c463bd3a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:41.770871 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-ab668c39-b65a-4da4-84e4-cb96c463bd3a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:41.782819 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ab668c39-b65a-4da4-84e4-cb96c463bd3a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:41.783308 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ab668c39-b65a-4da4-84e4-cb96c463bd3a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:41.784128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ab668c39-b65a-4da4-84e4-cb96c463bd3a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:41.784563 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ab668c39-b65a-4da4-84e4-cb96c463bd3a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:41.952730 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ab668c39-b65a-4da4-84e4-cb96c463bd3a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:41.965127 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ab668c39-b65a-4da4-84e4-cb96c463bd3a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:41.966629 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ab668c39-b65a-4da4-84e4-cb96c463bd3a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:41.968000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-ab668c39-b65a-4da4-84e4-cb96c463bd3a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.202012 Jun 16 19:47:41.971356 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 309/595] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:41 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:47:41.993783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-301279f9-6f68-436c-89a5-7cb3f52b63ff tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:41.994513 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-301279f9-6f68-436c-89a5-7cb3f52b63ff tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:42.001119 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-301279f9-6f68-436c-89a5-7cb3f52b63ff tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:42.001560 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-301279f9-6f68-436c-89a5-7cb3f52b63ff tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:42.002335 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-301279f9-6f68-436c-89a5-7cb3f52b63ff tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:42.002744 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-301279f9-6f68-436c-89a5-7cb3f52b63ff tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:42.063083 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-301279f9-6f68-436c-89a5-7cb3f52b63ff tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:42.063758 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-301279f9-6f68-436c-89a5-7cb3f52b63ff tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:42.064307 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-301279f9-6f68-436c-89a5-7cb3f52b63ff tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lazy-loading 'fault' on Instance uuid eb16dee5-a334-4d62-8b28-cd5a9632b6cc {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:47:42.135174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-301279f9-6f68-436c-89a5-7cb3f52b63ff tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:42.144448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-301279f9-6f68-436c-89a5-7cb3f52b63ff tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1331 microversion: 2.1 time: 0.154931 Jun 16 19:47:42.154954 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 310/596] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:41 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1331 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:42.154954 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-955575d8-d852-4ed6-abfb-2c9d3e9f4a7b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:42.154954 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-955575d8-d852-4ed6-abfb-2c9d3e9f4a7b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:42.164744 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-955575d8-d852-4ed6-abfb-2c9d3e9f4a7b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:42.164744 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-955575d8-d852-4ed6-abfb-2c9d3e9f4a7b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:42.164744 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-955575d8-d852-4ed6-abfb-2c9d3e9f4a7b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:42.164744 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-955575d8-d852-4ed6-abfb-2c9d3e9f4a7b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:42.194485 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:42.254037 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-955575d8-d852-4ed6-abfb-2c9d3e9f4a7b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:42.254037 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-955575d8-d852-4ed6-abfb-2c9d3e9f4a7b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1215 microversion: 2.1 time: 0.098087 Jun 16 19:47:42.254037 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 311/597] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:42 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:42.986624 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-05a1992a-b767-41c6-a3fa-6107c090dabd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:42.987280 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-05a1992a-b767-41c6-a3fa-6107c090dabd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:42.993919 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05a1992a-b767-41c6-a3fa-6107c090dabd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:42.994361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05a1992a-b767-41c6-a3fa-6107c090dabd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:42.995145 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05a1992a-b767-41c6-a3fa-6107c090dabd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:42.995575 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05a1992a-b767-41c6-a3fa-6107c090dabd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:43.128031 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-05a1992a-b767-41c6-a3fa-6107c090dabd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:43.136422 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-05a1992a-b767-41c6-a3fa-6107c090dabd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:43.137928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-05a1992a-b767-41c6-a3fa-6107c090dabd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:43.139124 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-05a1992a-b767-41c6-a3fa-6107c090dabd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.156527 Jun 16 19:47:43.139686 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 312/598] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:42 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:47:43.163133 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-af689b1c-fd7a-46fe-9f48-da8f5063243c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:43.163755 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-af689b1c-fd7a-46fe-9f48-da8f5063243c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:43.171303 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-af689b1c-fd7a-46fe-9f48-da8f5063243c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:43.171303 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-af689b1c-fd7a-46fe-9f48-da8f5063243c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:43.171852 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-af689b1c-fd7a-46fe-9f48-da8f5063243c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:43.172243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-af689b1c-fd7a-46fe-9f48-da8f5063243c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:43.202902 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-af689b1c-fd7a-46fe-9f48-da8f5063243c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:43.203370 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-af689b1c-fd7a-46fe-9f48-da8f5063243c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:43.203818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-af689b1c-fd7a-46fe-9f48-da8f5063243c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lazy-loading 'fault' on Instance uuid eb16dee5-a334-4d62-8b28-cd5a9632b6cc {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:47:43.248368 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-af689b1c-fd7a-46fe-9f48-da8f5063243c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:43.255647 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-af689b1c-fd7a-46fe-9f48-da8f5063243c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 200 len: 1331 microversion: 2.1 time: 0.096437 Jun 16 19:47:43.256199 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 313/599] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:43 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:43.260644 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-64580409-3e12-478a-9d92-e2bd8270632b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:43.261239 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-64580409-3e12-478a-9d92-e2bd8270632b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:43.266733 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-64580409-3e12-478a-9d92-e2bd8270632b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:43.268192 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-64580409-3e12-478a-9d92-e2bd8270632b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:43.268192 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-64580409-3e12-478a-9d92-e2bd8270632b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:43.268379 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-64580409-3e12-478a-9d92-e2bd8270632b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:43.332626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-64580409-3e12-478a-9d92-e2bd8270632b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:43.344710 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-64580409-3e12-478a-9d92-e2bd8270632b tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1215 microversion: 2.1 time: 0.087279 Jun 16 19:47:43.345331 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 314/600] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:43 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:43.351152 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-0d5b4306-daf5-4ddb-97b0-62fb67c5daaf tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] validate_networks() for None {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:47:43.593133 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-046dffbe-2fda-45fa-9a70-7acbcf0d8478 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29503ee7-35a9-4df4-be78-3fa88a36ff26"}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:47:43.593133 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-046dffbe-2fda-45fa-9a70-7acbcf0d8478 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:43.597696 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-046dffbe-2fda-45fa-9a70-7acbcf0d8478 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:43.598136 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-046dffbe-2fda-45fa-9a70-7acbcf0d8478 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:43.598985 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-046dffbe-2fda-45fa-9a70-7acbcf0d8478 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:43.599422 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-046dffbe-2fda-45fa-9a70-7acbcf0d8478 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:43.717320 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-0d5b4306-daf5-4ddb-97b0-62fb67c5daaf tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:47:43.718481 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-0d5b4306-daf5-4ddb-97b0-62fb67c5daaf tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:47:43.719171 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-0d5b4306-daf5-4ddb-97b0-62fb67c5daaf tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:47:43.719705 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-0d5b4306-daf5-4ddb-97b0-62fb67c5daaf tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:47:43.720205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-0d5b4306-daf5-4ddb-97b0-62fb67c5daaf tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:47:43.729244 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0d5b4306-daf5-4ddb-97b0-62fb67c5daaf tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:43.729690 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0d5b4306-daf5-4ddb-97b0-62fb67c5daaf tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:43.730510 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0d5b4306-daf5-4ddb-97b0-62fb67c5daaf tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:43.730997 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0d5b4306-daf5-4ddb-97b0-62fb67c5daaf tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:43.747023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-0d5b4306-daf5-4ddb-97b0-62fb67c5daaf tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Getting quotas for project d2d87fe212654666a76619c9afb14629. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:47:43.750724 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-0d5b4306-daf5-4ddb-97b0-62fb67c5daaf tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Getting quotas for user 519ddd36b0084a42b18a197b0e5df24f and project d2d87fe212654666a76619c9afb14629. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:47:43.761926 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0d5b4306-daf5-4ddb-97b0-62fb67c5daaf tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:47:43.764124 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0d5b4306-daf5-4ddb-97b0-62fb67c5daaf tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcb2be6-02db-4853-a8d6-6478a75f26a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:47:43.987500 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0d5b4306-daf5-4ddb-97b0-62fb67c5daaf tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.683357 Jun 16 19:47:43.988325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 287/601] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:47:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 7685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:47:43.998639 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9a357ada-a5e2-46c7-8a4e-16b88c615583 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:43.999270 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9a357ada-a5e2-46c7-8a4e-16b88c615583 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:44.058782 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9a357ada-a5e2-46c7-8a4e-16b88c615583 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:44.070117 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9a357ada-a5e2-46c7-8a4e-16b88c615583 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1214 microversion: 2.1 time: 0.072215 Jun 16 19:47:44.070117 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 288/602] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:43 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:44.157024 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-01009cbb-c03f-4e2b-8ffb-e9c42fdfeef5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:44.157621 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-01009cbb-c03f-4e2b-8ffb-e9c42fdfeef5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:44.163578 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01009cbb-c03f-4e2b-8ffb-e9c42fdfeef5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:44.164028 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01009cbb-c03f-4e2b-8ffb-e9c42fdfeef5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:44.164779 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01009cbb-c03f-4e2b-8ffb-e9c42fdfeef5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:44.165280 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01009cbb-c03f-4e2b-8ffb-e9c42fdfeef5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:44.293652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-01009cbb-c03f-4e2b-8ffb-e9c42fdfeef5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:44.302205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-01009cbb-c03f-4e2b-8ffb-e9c42fdfeef5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:44.303794 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-01009cbb-c03f-4e2b-8ffb-e9c42fdfeef5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:44.305020 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-01009cbb-c03f-4e2b-8ffb-e9c42fdfeef5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.151755 Jun 16 19:47:44.306206 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 289/603] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:44 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:47:44.311967 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-93de3185-6091-46ef-8663-96bdaa3ac919 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:44.312852 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-93de3185-6091-46ef-8663-96bdaa3ac919 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:44.322940 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93de3185-6091-46ef-8663-96bdaa3ac919 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:44.323410 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93de3185-6091-46ef-8663-96bdaa3ac919 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:44.324206 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93de3185-6091-46ef-8663-96bdaa3ac919 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:44.324647 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93de3185-6091-46ef-8663-96bdaa3ac919 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:44.338346 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-93de3185-6091-46ef-8663-96bdaa3ac919 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] HTTP exception thrown: Instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc could not be found. Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-93de3185-6091-46ef-8663-96bdaa3ac919 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Request method failure captured: Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc HTTP/1.1 Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4fyBPW6I9Gw6XK8Mc3wtez0zYsc4UrjgW7z4WtApzgBYkrjjskhl3gYkWnE6yWJE5ICrDHXLgUYO-0AGzBAc7qg6XibMR0r_JEUP5LVfGl7WyQCTm5mkF0v4IWKdbz7Ao2NSIM42ZaaFkj5iXJmRir4voVV15buKmDOb_Ti4CHFnHY Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:47:44.340093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:47:44.341702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47a4ab888dd74218ab5d7812ad095371", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:47:44.341702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:47:44.341702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:47:44.341702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:47:44.341702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:47:44.341702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:47:44.341702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:47:44.341702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 4df05cbf303c4524a665b429f240a17a Jun 16 19:47:44.341702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:47:44.341702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:47:44.341702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc could not be found. Jun 16 19:47:44.341702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': 'eb16dee5-a334-4d62-8b28-cd5a9632b6cc'} Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc could not be found. Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:47:44.342623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:47:44.344141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:47:44.344141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:47:44.344141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:47:44.344141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:47:44.344141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:47:44.344141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:47:44.344141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:47:44.344141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc could not be found. Jun 16 19:47:44.344141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:47:44.344141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:47:44.344141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:47:44.344141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:47:44.344141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:47:44.344141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:47:44.344141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:47:44.344141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:47:44.344141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc could not be found. Jun 16 19:47:44.344141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:47:44.345756 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-93de3185-6091-46ef-8663-96bdaa3ac919 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Returning 404 to user: Instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:47:44.345756 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-93de3185-6091-46ef-8663-96bdaa3ac919 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 404 len: 111 microversion: 2.1 time: 0.033652 Jun 16 19:47:44.345756 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 290/604] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:44 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:47:44.350001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b9feb22b-116d-4b2b-aa9c-231cfe5a7939 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '.version_select at 0x7f0501524550>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:44.515003 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b9feb22b-116d-4b2b-aa9c-231cfe5a7939 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-403229789" status: 202 len: 0 microversion: 2.1 time: 0.168447 Jun 16 19:47:44.515693 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 291/605] 10.222.0.36 () {58 vars in 1217 bytes} [Thu Jun 16 19:47:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-403229789 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:47:44.521499 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-939fdd37-94aa-43fa-b22b-ef2656fff413 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:44.522118 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-939fdd37-94aa-43fa-b22b-ef2656fff413 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:44.531159 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-939fdd37-94aa-43fa-b22b-ef2656fff413 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:44.531619 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-939fdd37-94aa-43fa-b22b-ef2656fff413 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:44.532404 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-939fdd37-94aa-43fa-b22b-ef2656fff413 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:44.532843 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-939fdd37-94aa-43fa-b22b-ef2656fff413 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:44.646337 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-939fdd37-94aa-43fa-b22b-ef2656fff413 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:44.653746 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-939fdd37-94aa-43fa-b22b-ef2656fff413 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1271 microversion: 2.1 time: 0.137205 Jun 16 19:47:44.654396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 292/606] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:44 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:45.085077 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-25b36e0e-15ed-4799-b5f6-91d2134a71e4 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:45.085688 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-25b36e0e-15ed-4799-b5f6-91d2134a71e4 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:45.143708 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-25b36e0e-15ed-4799-b5f6-91d2134a71e4 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:45.152291 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-25b36e0e-15ed-4799-b5f6-91d2134a71e4 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1214 microversion: 2.1 time: 0.070933 Jun 16 19:47:45.154531 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 293/607] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:45 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:45.325503 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4c8c2306-28d5-4a40-b255-12c51c395e9b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:45.326155 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4c8c2306-28d5-4a40-b255-12c51c395e9b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:45.332834 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4c8c2306-28d5-4a40-b255-12c51c395e9b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:45.333284 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4c8c2306-28d5-4a40-b255-12c51c395e9b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:45.334050 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4c8c2306-28d5-4a40-b255-12c51c395e9b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:45.334485 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4c8c2306-28d5-4a40-b255-12c51c395e9b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:45.522741 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4c8c2306-28d5-4a40-b255-12c51c395e9b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:45.531853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4c8c2306-28d5-4a40-b255-12c51c395e9b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:45.533356 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4c8c2306-28d5-4a40-b255-12c51c395e9b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:45.534593 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4c8c2306-28d5-4a40-b255-12c51c395e9b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.213237 Jun 16 19:47:45.535256 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 294/608] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:45 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:47:45.602238 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5462062e-dd0f-423d-8ea6-b5982871fcca tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:45.603721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5462062e-dd0f-423d-8ea6-b5982871fcca tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:45.616645 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5462062e-dd0f-423d-8ea6-b5982871fcca tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:45.617015 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5462062e-dd0f-423d-8ea6-b5982871fcca tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:45.617837 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5462062e-dd0f-423d-8ea6-b5982871fcca tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:45.618276 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5462062e-dd0f-423d-8ea6-b5982871fcca tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:45.744108 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-5462062e-dd0f-423d-8ea6-b5982871fcca tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lazy-loading 'services' on Instance uuid 5c939c84-1712-4551-a3e3-cf42be4113fe {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:47:45.862046 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-046dffbe-2fda-45fa-9a70-7acbcf0d8478 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "POST /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.278674 Jun 16 19:47:45.870564 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 315/609] 10.222.0.36 () {60 vars in 1322 bytes} [Thu Jun 16 19:47:43 2022] POST /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments => generated 194 bytes in 2281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:47:45.870564 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-71141d04-e427-47ec-b3d2-e72fc69aeead tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:45.870564 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-71141d04-e427-47ec-b3d2-e72fc69aeead tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:45.877136 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-71141d04-e427-47ec-b3d2-e72fc69aeead tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:45.877831 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-71141d04-e427-47ec-b3d2-e72fc69aeead tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:45.878767 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-71141d04-e427-47ec-b3d2-e72fc69aeead tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:45.879395 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-71141d04-e427-47ec-b3d2-e72fc69aeead tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:45.963921 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-71141d04-e427-47ec-b3d2-e72fc69aeead tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:45.988681 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-71141d04-e427-47ec-b3d2-e72fc69aeead tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1279 microversion: 2.1 time: 0.123663 Jun 16 19:47:45.989274 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 316/610] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:45 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1279 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:46.001607 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7e372c07-cc56-45ed-80e9-d29c9dd6d977 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:47:46.002896 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-7e372c07-cc56-45ed-80e9-d29c9dd6d977 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:46.010342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7e372c07-cc56-45ed-80e9-d29c9dd6d977 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:46.010792 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7e372c07-cc56-45ed-80e9-d29c9dd6d977 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:46.012152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7e372c07-cc56-45ed-80e9-d29c9dd6d977 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:46.012774 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7e372c07-cc56-45ed-80e9-d29c9dd6d977 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:46.036656 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-7e372c07-cc56-45ed-80e9-d29c9dd6d977 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lazy-loading 'flavor' on Instance uuid ea242cf7-0535-4532-aaa0-59848bf41c73 {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:47:46.269883 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5462062e-dd0f-423d-8ea6-b5982871fcca tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments/1def8c3b-37e2-495d-ae2f-0caec5f46b31" status: 202 len: 0 microversion: 2.1 time: 0.671348 Jun 16 19:47:46.273577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 295/611] 10.222.0.36 () {58 vars in 1415 bytes} [Thu Jun 16 19:47:45 2022] DELETE /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments/1def8c3b-37e2-495d-ae2f-0caec5f46b31 => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:47:46.290686 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8da5f41d-73d9-43ac-b32d-2be342885915 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:46.293404 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8da5f41d-73d9-43ac-b32d-2be342885915 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:46.304508 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8da5f41d-73d9-43ac-b32d-2be342885915 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:46.305172 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8da5f41d-73d9-43ac-b32d-2be342885915 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:46.306129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8da5f41d-73d9-43ac-b32d-2be342885915 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:46.306722 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8da5f41d-73d9-43ac-b32d-2be342885915 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:46.381222 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8da5f41d-73d9-43ac-b32d-2be342885915 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:46.388792 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8da5f41d-73d9-43ac-b32d-2be342885915 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1218 microversion: 2.1 time: 0.112874 Jun 16 19:47:46.389355 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 296/612] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:46 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:46.395229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-dc1eb418-d6b0-45df-85c9-278bd8cc212c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:46.396443 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-dc1eb418-d6b0-45df-85c9-278bd8cc212c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:46.408438 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc1eb418-d6b0-45df-85c9-278bd8cc212c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:46.408438 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc1eb418-d6b0-45df-85c9-278bd8cc212c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:46.408438 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc1eb418-d6b0-45df-85c9-278bd8cc212c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:46.408438 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc1eb418-d6b0-45df-85c9-278bd8cc212c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:46.437406 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-dc1eb418-d6b0-45df-85c9-278bd8cc212c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047010 Jun 16 19:47:46.437971 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 297/613] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:47:46 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:47:46.554071 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f5585136-2acc-47d5-af28-de80d4d4f221 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:46.554683 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f5585136-2acc-47d5-af28-de80d4d4f221 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:46.561927 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f5585136-2acc-47d5-af28-de80d4d4f221 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:46.562450 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f5585136-2acc-47d5-af28-de80d4d4f221 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:46.563353 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f5585136-2acc-47d5-af28-de80d4d4f221 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:46.563857 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f5585136-2acc-47d5-af28-de80d4d4f221 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:46.713689 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f5585136-2acc-47d5-af28-de80d4d4f221 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:46.722197 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f5585136-2acc-47d5-af28-de80d4d4f221 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:46.723719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f5585136-2acc-47d5-af28-de80d4d4f221 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:46.725132 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f5585136-2acc-47d5-af28-de80d4d4f221 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.175039 Jun 16 19:47:46.725687 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 298/614] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:46 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:47.006112 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1961e50b-3114-489d-94b3-f0e47e0eb4e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:47.006733 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1961e50b-3114-489d-94b3-f0e47e0eb4e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:47.012872 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1961e50b-3114-489d-94b3-f0e47e0eb4e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:47.013315 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1961e50b-3114-489d-94b3-f0e47e0eb4e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:47.014071 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1961e50b-3114-489d-94b3-f0e47e0eb4e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:47.014501 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1961e50b-3114-489d-94b3-f0e47e0eb4e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:47.025006 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-7e372c07-cc56-45ed-80e9-d29c9dd6d977 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "POST /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/action" status: 200 len: 32 microversion: 2.1 time: 1.032780 Jun 16 19:47:47.026773 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 317/615] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Jun 16 19:47:45 2022] POST /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/action => generated 32 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:47:47.035412 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6288e95f-5d16-4c6d-8eb0-c804f639a9ca tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:47.042078 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6288e95f-5d16-4c6d-8eb0-c804f639a9ca tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:47.044319 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6288e95f-5d16-4c6d-8eb0-c804f639a9ca tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:47.044611 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6288e95f-5d16-4c6d-8eb0-c804f639a9ca tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:47.045467 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6288e95f-5d16-4c6d-8eb0-c804f639a9ca tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:47.046102 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6288e95f-5d16-4c6d-8eb0-c804f639a9ca tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:47.156041 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1961e50b-3114-489d-94b3-f0e47e0eb4e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:47.163937 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1961e50b-3114-489d-94b3-f0e47e0eb4e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.161953 Jun 16 19:47:47.167779 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 299/616] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:47 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:47.201042 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6288e95f-5d16-4c6d-8eb0-c804f639a9ca tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:47.209084 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6288e95f-5d16-4c6d-8eb0-c804f639a9ca tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.177771 Jun 16 19:47:47.218583 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 318/617] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:47 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:47.405486 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2fc9776f-7638-40e1-b079-8b1e7b3e34ce tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:47.406104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2fc9776f-7638-40e1-b079-8b1e7b3e34ce tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:47.412073 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2fc9776f-7638-40e1-b079-8b1e7b3e34ce tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:47.412525 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2fc9776f-7638-40e1-b079-8b1e7b3e34ce tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:47.413290 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2fc9776f-7638-40e1-b079-8b1e7b3e34ce tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:47.413729 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2fc9776f-7638-40e1-b079-8b1e7b3e34ce tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:47.449388 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-02fba6a6-85ca-41d4-96bb-b74ec1a8d585 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:47.450445 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-02fba6a6-85ca-41d4-96bb-b74ec1a8d585 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:47.456333 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=2 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:47.458776 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-02fba6a6-85ca-41d4-96bb-b74ec1a8d585 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:47.459484 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-02fba6a6-85ca-41d4-96bb-b74ec1a8d585 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:47.460472 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-02fba6a6-85ca-41d4-96bb-b74ec1a8d585 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:47.461095 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-02fba6a6-85ca-41d4-96bb-b74ec1a8d585 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:47.494632 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-02fba6a6-85ca-41d4-96bb-b74ec1a8d585 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049516 Jun 16 19:47:47.495324 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 319/618] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:47:47 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:47:47.516086 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2fc9776f-7638-40e1-b079-8b1e7b3e34ce tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:47.524105 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2fc9776f-7638-40e1-b079-8b1e7b3e34ce tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1210 microversion: 2.1 time: 0.122369 Jun 16 19:47:47.525185 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 300/619] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:47 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1210 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:47.744291 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-65966d12-888a-4cb7-aa48-fd9f4c5a0a31 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:47.744901 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-65966d12-888a-4cb7-aa48-fd9f4c5a0a31 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:47.751377 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-65966d12-888a-4cb7-aa48-fd9f4c5a0a31 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:47.751823 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-65966d12-888a-4cb7-aa48-fd9f4c5a0a31 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:47.752579 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-65966d12-888a-4cb7-aa48-fd9f4c5a0a31 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:47.753015 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-65966d12-888a-4cb7-aa48-fd9f4c5a0a31 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:47.882694 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-65966d12-888a-4cb7-aa48-fd9f4c5a0a31 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:47.891633 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-65966d12-888a-4cb7-aa48-fd9f4c5a0a31 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:47.893150 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-65966d12-888a-4cb7-aa48-fd9f4c5a0a31 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:47.894332 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-65966d12-888a-4cb7-aa48-fd9f4c5a0a31 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.153965 Jun 16 19:47:47.894879 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 320/620] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:47 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:48.181174 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b0662eb8-2f76-4faa-aed2-ffefb6594658 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:48.181784 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b0662eb8-2f76-4faa-aed2-ffefb6594658 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:48.187799 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b0662eb8-2f76-4faa-aed2-ffefb6594658 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:48.188241 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b0662eb8-2f76-4faa-aed2-ffefb6594658 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:48.188995 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b0662eb8-2f76-4faa-aed2-ffefb6594658 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:48.189419 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b0662eb8-2f76-4faa-aed2-ffefb6594658 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:48.225497 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-509cc6ec-e84b-44a4-9e06-fcdde6c5b6df tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:48.226117 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-509cc6ec-e84b-44a4-9e06-fcdde6c5b6df tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:48.232770 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-509cc6ec-e84b-44a4-9e06-fcdde6c5b6df tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:48.233219 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-509cc6ec-e84b-44a4-9e06-fcdde6c5b6df tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:48.236416 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-509cc6ec-e84b-44a4-9e06-fcdde6c5b6df tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:48.236416 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-509cc6ec-e84b-44a4-9e06-fcdde6c5b6df tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:48.371134 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-509cc6ec-e84b-44a4-9e06-fcdde6c5b6df tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:48.379410 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-509cc6ec-e84b-44a4-9e06-fcdde6c5b6df tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.157599 Jun 16 19:47:48.380139 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 321/621] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:48 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:48.400740 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b0662eb8-2f76-4faa-aed2-ffefb6594658 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:48.408405 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b0662eb8-2f76-4faa-aed2-ffefb6594658 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.231050 Jun 16 19:47:48.408965 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 301/622] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:48 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:48.506976 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8ce7266e-53f5-4a22-a9d0-ee7d7cff074a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:48.508242 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8ce7266e-53f5-4a22-a9d0-ee7d7cff074a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:48.514419 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8ce7266e-53f5-4a22-a9d0-ee7d7cff074a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:48.514875 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8ce7266e-53f5-4a22-a9d0-ee7d7cff074a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:48.515699 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8ce7266e-53f5-4a22-a9d0-ee7d7cff074a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:48.516137 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8ce7266e-53f5-4a22-a9d0-ee7d7cff074a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:48.542076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-748a1577-10d7-45a6-a3d8-a876c0889af1 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:48.542673 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-748a1577-10d7-45a6-a3d8-a876c0889af1 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:48.545837 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8ce7266e-53f5-4a22-a9d0-ee7d7cff074a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043903 Jun 16 19:47:48.546409 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 322/623] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:47:48 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:47:48.548887 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-748a1577-10d7-45a6-a3d8-a876c0889af1 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:48.549071 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-748a1577-10d7-45a6-a3d8-a876c0889af1 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:48.549809 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-748a1577-10d7-45a6-a3d8-a876c0889af1 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:48.550233 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-748a1577-10d7-45a6-a3d8-a876c0889af1 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:48.617732 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-748a1577-10d7-45a6-a3d8-a876c0889af1 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:48.625180 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-748a1577-10d7-45a6-a3d8-a876c0889af1 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1266 microversion: 2.1 time: 0.087396 Jun 16 19:47:48.625751 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 302/624] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:48 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:48.913837 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-cecd51ab-c821-4a17-b8f0-d06919fd40b3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:48.914361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-cecd51ab-c821-4a17-b8f0-d06919fd40b3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:48.920766 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cecd51ab-c821-4a17-b8f0-d06919fd40b3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:48.921208 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cecd51ab-c821-4a17-b8f0-d06919fd40b3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:48.921956 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cecd51ab-c821-4a17-b8f0-d06919fd40b3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:48.922388 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cecd51ab-c821-4a17-b8f0-d06919fd40b3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:49.059975 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-d4480263-6bfe-4ffd-9861-cb7c69d56217 req-dc34ad1c-629d-4fa1-8467-4cf75b9796ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e487bec-d93f-4777-a2df-96eab8459319", "tag": "0d5544ee-f9fd-469d-8be9-aae37bba47b9"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:47:49.061649 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-cecd51ab-c821-4a17-b8f0-d06919fd40b3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:49.070038 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-d4480263-6bfe-4ffd-9861-cb7c69d56217 req-dc34ad1c-629d-4fa1-8467-4cf75b9796ab service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:49.070487 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-d4480263-6bfe-4ffd-9861-cb7c69d56217 req-dc34ad1c-629d-4fa1-8467-4cf75b9796ab service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:49.071811 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-cecd51ab-c821-4a17-b8f0-d06919fd40b3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:49.073361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-cecd51ab-c821-4a17-b8f0-d06919fd40b3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:49.074739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-cecd51ab-c821-4a17-b8f0-d06919fd40b3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.164934 Jun 16 19:47:49.075483 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 323/625] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:48 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:49.084464 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-d4480263-6bfe-4ffd-9861-cb7c69d56217 req-dc34ad1c-629d-4fa1-8467-4cf75b9796ab service nova] Creating event network-changed:0d5544ee-f9fd-469d-8be9-aae37bba47b9 for instance 8e487bec-d93f-4777-a2df-96eab8459319 on hv-cinder-84617 Jun 16 19:47:49.089812 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-d4480263-6bfe-4ffd-9861-cb7c69d56217 req-dc34ad1c-629d-4fa1-8467-4cf75b9796ab service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034483 Jun 16 19:47:49.090393 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 303/626] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:47:49.397610 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3cb5ca8b-8e76-4353-9c3c-d25190f69304 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:49.398247 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-3cb5ca8b-8e76-4353-9c3c-d25190f69304 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:49.404568 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3cb5ca8b-8e76-4353-9c3c-d25190f69304 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:49.405022 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3cb5ca8b-8e76-4353-9c3c-d25190f69304 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:49.405801 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3cb5ca8b-8e76-4353-9c3c-d25190f69304 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:49.406239 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3cb5ca8b-8e76-4353-9c3c-d25190f69304 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:49.425542 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:49.426245 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2564412a-e851-4159-986d-ca9556baab2a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:49.427063 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2564412a-e851-4159-986d-ca9556baab2a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:49.434024 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2564412a-e851-4159-986d-ca9556baab2a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:49.434486 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2564412a-e851-4159-986d-ca9556baab2a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:49.435289 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2564412a-e851-4159-986d-ca9556baab2a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:49.435715 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2564412a-e851-4159-986d-ca9556baab2a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:49.517726 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=2 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:49.539649 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3cb5ca8b-8e76-4353-9c3c-d25190f69304 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:49.548565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-3cb5ca8b-8e76-4353-9c3c-d25190f69304 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.154961 Jun 16 19:47:49.549146 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 324/627] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:49 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:49.564192 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9ce8a062-1ef3-4811-9619-004c3e04cd53 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:49.565170 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9ce8a062-1ef3-4811-9619-004c3e04cd53 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:49.572034 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9ce8a062-1ef3-4811-9619-004c3e04cd53 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:49.572485 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9ce8a062-1ef3-4811-9619-004c3e04cd53 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:49.573239 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9ce8a062-1ef3-4811-9619-004c3e04cd53 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:49.573668 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9ce8a062-1ef3-4811-9619-004c3e04cd53 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:49.604922 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9ce8a062-1ef3-4811-9619-004c3e04cd53 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044457 Jun 16 19:47:49.608699 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 325/628] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:47:49 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:47:49.641978 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-76a21d8b-1fd5-4f22-95bf-29c024e3d300 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:49.642418 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-76a21d8b-1fd5-4f22-95bf-29c024e3d300 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:49.648477 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-76a21d8b-1fd5-4f22-95bf-29c024e3d300 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:49.648929 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-76a21d8b-1fd5-4f22-95bf-29c024e3d300 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:49.649858 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-76a21d8b-1fd5-4f22-95bf-29c024e3d300 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:49.650304 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-76a21d8b-1fd5-4f22-95bf-29c024e3d300 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:49.667137 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2564412a-e851-4159-986d-ca9556baab2a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:49.675813 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2564412a-e851-4159-986d-ca9556baab2a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.253834 Jun 16 19:47:49.676636 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 304/629] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:49 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:49.720897 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-76a21d8b-1fd5-4f22-95bf-29c024e3d300 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:49.727956 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-76a21d8b-1fd5-4f22-95bf-29c024e3d300 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1266 microversion: 2.1 time: 0.089644 Jun 16 19:47:49.728521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 326/630] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:49 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:50.093581 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-15e6586c-ddae-48ff-a87f-aa6f4180a4cf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:50.094181 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-15e6586c-ddae-48ff-a87f-aa6f4180a4cf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:50.100483 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-15e6586c-ddae-48ff-a87f-aa6f4180a4cf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:50.100926 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-15e6586c-ddae-48ff-a87f-aa6f4180a4cf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:50.101670 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-15e6586c-ddae-48ff-a87f-aa6f4180a4cf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:50.102731 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-15e6586c-ddae-48ff-a87f-aa6f4180a4cf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:50.120741 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:50.230283 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-15e6586c-ddae-48ff-a87f-aa6f4180a4cf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:50.238514 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-15e6586c-ddae-48ff-a87f-aa6f4180a4cf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:50.240024 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-15e6586c-ddae-48ff-a87f-aa6f4180a4cf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:50.241160 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-15e6586c-ddae-48ff-a87f-aa6f4180a4cf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.151586 Jun 16 19:47:50.241711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 305/631] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:50 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:50.565631 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-cf82740b-5be5-4d95-986e-02fbb17bcbdd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:50.568160 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-cf82740b-5be5-4d95-986e-02fbb17bcbdd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:50.574084 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cf82740b-5be5-4d95-986e-02fbb17bcbdd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:50.574529 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cf82740b-5be5-4d95-986e-02fbb17bcbdd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:50.575312 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cf82740b-5be5-4d95-986e-02fbb17bcbdd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:50.575743 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cf82740b-5be5-4d95-986e-02fbb17bcbdd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:50.616619 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4a87356b-7262-4fa6-8470-3e66c9bd0693 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:50.617693 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4a87356b-7262-4fa6-8470-3e66c9bd0693 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:50.624115 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a87356b-7262-4fa6-8470-3e66c9bd0693 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:50.624636 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a87356b-7262-4fa6-8470-3e66c9bd0693 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:50.625448 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a87356b-7262-4fa6-8470-3e66c9bd0693 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:50.625875 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a87356b-7262-4fa6-8470-3e66c9bd0693 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:50.669762 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4a87356b-7262-4fa6-8470-3e66c9bd0693 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056959 Jun 16 19:47:50.670346 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 306/632] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:47:50 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:47:50.692826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-caa21212-1f51-4dd8-be39-a870ef06ec08 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:50.693892 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-caa21212-1f51-4dd8-be39-a870ef06ec08 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:50.700964 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-caa21212-1f51-4dd8-be39-a870ef06ec08 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:50.701409 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-caa21212-1f51-4dd8-be39-a870ef06ec08 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:50.702173 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-caa21212-1f51-4dd8-be39-a870ef06ec08 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:50.702601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-caa21212-1f51-4dd8-be39-a870ef06ec08 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:50.719750 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-cf82740b-5be5-4d95-986e-02fbb17bcbdd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:50.728044 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-cf82740b-5be5-4d95-986e-02fbb17bcbdd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.166300 Jun 16 19:47:50.738145 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 327/633] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:50 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:50.745569 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1a1764df-a570-41aa-b8ff-1cb3423cc8ea tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:50.746411 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-1a1764df-a570-41aa-b8ff-1cb3423cc8ea tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:50.753262 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1a1764df-a570-41aa-b8ff-1cb3423cc8ea tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:50.753928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1a1764df-a570-41aa-b8ff-1cb3423cc8ea tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:50.755049 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1a1764df-a570-41aa-b8ff-1cb3423cc8ea tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:50.755638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1a1764df-a570-41aa-b8ff-1cb3423cc8ea tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:50.826420 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1a1764df-a570-41aa-b8ff-1cb3423cc8ea tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:50.834361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-1a1764df-a570-41aa-b8ff-1cb3423cc8ea tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1274 microversion: 2.1 time: 0.093872 Jun 16 19:47:50.848133 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 328/634] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:50 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:51.071581 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-caa21212-1f51-4dd8-be39-a870ef06ec08 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:51.077315 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-caa21212-1f51-4dd8-be39-a870ef06ec08 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.388169 Jun 16 19:47:51.077827 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 307/635] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:50 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:51.260140 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1722e31c-5212-4c3a-bab4-93e0915b880d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:51.260749 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-1722e31c-5212-4c3a-bab4-93e0915b880d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:51.267512 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1722e31c-5212-4c3a-bab4-93e0915b880d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:51.267969 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1722e31c-5212-4c3a-bab4-93e0915b880d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:51.268728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1722e31c-5212-4c3a-bab4-93e0915b880d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:51.269165 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1722e31c-5212-4c3a-bab4-93e0915b880d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:51.412574 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1722e31c-5212-4c3a-bab4-93e0915b880d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:51.421124 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1722e31c-5212-4c3a-bab4-93e0915b880d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:51.422595 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1722e31c-5212-4c3a-bab4-93e0915b880d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:51.423767 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-1722e31c-5212-4c3a-bab4-93e0915b880d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.168237 Jun 16 19:47:51.424322 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 329/636] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:51 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:51.682365 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0776be1d-b21b-4aaa-b313-9ab7b71c0496 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:51.685661 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0776be1d-b21b-4aaa-b313-9ab7b71c0496 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:51.689617 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0776be1d-b21b-4aaa-b313-9ab7b71c0496 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:51.690037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0776be1d-b21b-4aaa-b313-9ab7b71c0496 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:51.691013 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0776be1d-b21b-4aaa-b313-9ab7b71c0496 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:51.691628 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0776be1d-b21b-4aaa-b313-9ab7b71c0496 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:51.725488 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0776be1d-b21b-4aaa-b313-9ab7b71c0496 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047754 Jun 16 19:47:51.726382 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 308/637] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:47:51 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:47:51.745752 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8b90b5d4-4574-4f49-baf1-f868a0d37fb3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:51.747126 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8b90b5d4-4574-4f49-baf1-f868a0d37fb3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:51.753713 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8b90b5d4-4574-4f49-baf1-f868a0d37fb3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:51.754371 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8b90b5d4-4574-4f49-baf1-f868a0d37fb3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:51.755164 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8b90b5d4-4574-4f49-baf1-f868a0d37fb3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:51.755600 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8b90b5d4-4574-4f49-baf1-f868a0d37fb3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:51.851640 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-44008f9b-1e0a-4529-9bd4-2f5264721b63 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:51.852827 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-44008f9b-1e0a-4529-9bd4-2f5264721b63 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:51.858902 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-44008f9b-1e0a-4529-9bd4-2f5264721b63 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:51.859382 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-44008f9b-1e0a-4529-9bd4-2f5264721b63 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:51.860348 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-44008f9b-1e0a-4529-9bd4-2f5264721b63 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:51.860787 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-44008f9b-1e0a-4529-9bd4-2f5264721b63 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:51.903512 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8b90b5d4-4574-4f49-baf1-f868a0d37fb3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:51.911392 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8b90b5d4-4574-4f49-baf1-f868a0d37fb3 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.170059 Jun 16 19:47:51.912349 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 330/638] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:51 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:51.948316 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-44008f9b-1e0a-4529-9bd4-2f5264721b63 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:51.955810 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-44008f9b-1e0a-4529-9bd4-2f5264721b63 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1272 microversion: 2.1 time: 0.108067 Jun 16 19:47:51.956375 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 309/639] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:51 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:52.094037 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-66a68ea2-2cc8-47c4-ac90-4a6924a08956 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:52.094719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-66a68ea2-2cc8-47c4-ac90-4a6924a08956 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:52.100829 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-66a68ea2-2cc8-47c4-ac90-4a6924a08956 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:52.101281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-66a68ea2-2cc8-47c4-ac90-4a6924a08956 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:52.102046 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-66a68ea2-2cc8-47c4-ac90-4a6924a08956 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:52.102482 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-66a68ea2-2cc8-47c4-ac90-4a6924a08956 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:52.229685 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-66a68ea2-2cc8-47c4-ac90-4a6924a08956 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:52.237374 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-66a68ea2-2cc8-47c4-ac90-4a6924a08956 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.147182 Jun 16 19:47:52.237947 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 331/640] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:52 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:52.442583 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-963ecd7d-9d27-4358-ab70-a8d9a76e6f42 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:52.442583 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-963ecd7d-9d27-4358-ab70-a8d9a76e6f42 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:52.449022 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-963ecd7d-9d27-4358-ab70-a8d9a76e6f42 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:52.449465 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-963ecd7d-9d27-4358-ab70-a8d9a76e6f42 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:52.450236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-963ecd7d-9d27-4358-ab70-a8d9a76e6f42 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:52.450673 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-963ecd7d-9d27-4358-ab70-a8d9a76e6f42 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:52.580480 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-963ecd7d-9d27-4358-ab70-a8d9a76e6f42 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:52.589036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-963ecd7d-9d27-4358-ab70-a8d9a76e6f42 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:52.590513 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-963ecd7d-9d27-4358-ab70-a8d9a76e6f42 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:52.591690 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-963ecd7d-9d27-4358-ab70-a8d9a76e6f42 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.153939 Jun 16 19:47:52.592240 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 310/641] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:52 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:52.737152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f4ed4be9-0420-42af-b3df-b26b2f51c8de tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:52.738150 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f4ed4be9-0420-42af-b3df-b26b2f51c8de tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:52.744340 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f4ed4be9-0420-42af-b3df-b26b2f51c8de tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:52.744788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f4ed4be9-0420-42af-b3df-b26b2f51c8de tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:52.745552 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f4ed4be9-0420-42af-b3df-b26b2f51c8de tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:52.745982 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f4ed4be9-0420-42af-b3df-b26b2f51c8de tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:52.776825 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f4ed4be9-0420-42af-b3df-b26b2f51c8de tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043518 Jun 16 19:47:52.777638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 332/642] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:47:52 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:47:52.928876 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1575df60-bbe7-49d7-94ce-b9a774054a26 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:52.929540 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1575df60-bbe7-49d7-94ce-b9a774054a26 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:52.936103 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1575df60-bbe7-49d7-94ce-b9a774054a26 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:52.936549 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1575df60-bbe7-49d7-94ce-b9a774054a26 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:52.937307 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1575df60-bbe7-49d7-94ce-b9a774054a26 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:52.937737 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1575df60-bbe7-49d7-94ce-b9a774054a26 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:52.980054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-dd8c9bc4-78dc-4fbe-b3f9-3ea7cc4a0ba9 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:52.980675 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-dd8c9bc4-78dc-4fbe-b3f9-3ea7cc4a0ba9 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:52.986991 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-dd8c9bc4-78dc-4fbe-b3f9-3ea7cc4a0ba9 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:52.987576 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-dd8c9bc4-78dc-4fbe-b3f9-3ea7cc4a0ba9 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:52.988480 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-dd8c9bc4-78dc-4fbe-b3f9-3ea7cc4a0ba9 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:52.988917 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-dd8c9bc4-78dc-4fbe-b3f9-3ea7cc4a0ba9 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:53.136529 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-dd8c9bc4-78dc-4fbe-b3f9-3ea7cc4a0ba9 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:53.138328 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1575df60-bbe7-49d7-94ce-b9a774054a26 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:53.144477 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-dd8c9bc4-78dc-4fbe-b3f9-3ea7cc4a0ba9 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.168894 Jun 16 19:47:53.145044 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 333/643] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:52 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:53.146180 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1575df60-bbe7-49d7-94ce-b9a774054a26 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.221093 Jun 16 19:47:53.146726 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 311/644] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:52 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:53.256328 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-432e838f-975e-4bcb-b636-e929722e2fe3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:53.256988 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-432e838f-975e-4bcb-b636-e929722e2fe3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:53.267402 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-432e838f-975e-4bcb-b636-e929722e2fe3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:53.267820 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-432e838f-975e-4bcb-b636-e929722e2fe3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:53.268627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-432e838f-975e-4bcb-b636-e929722e2fe3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:53.269072 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-432e838f-975e-4bcb-b636-e929722e2fe3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:53.435561 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-432e838f-975e-4bcb-b636-e929722e2fe3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:53.443850 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-432e838f-975e-4bcb-b636-e929722e2fe3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.192304 Jun 16 19:47:53.444939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 334/645] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:53 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:53.592556 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-3fc43a99-96e2-447b-8f4d-9ebc4716cdff req-04445973-69e7-40f9-a38a-4e3a0d8c06e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1303e37f-ab18-42db-8f6f-dfe6580c7b0f", "tag": "a195dea2-c192-44c9-a838-68ed16f657df"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:47:53.601098 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-3fc43a99-96e2-447b-8f4d-9ebc4716cdff req-04445973-69e7-40f9-a38a-4e3a0d8c06e5 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:53.601543 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-3fc43a99-96e2-447b-8f4d-9ebc4716cdff req-04445973-69e7-40f9-a38a-4e3a0d8c06e5 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:53.610448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9204f5b1-d557-48b9-8348-c3e08cc649b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:53.611352 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9204f5b1-d557-48b9-8348-c3e08cc649b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:53.613919 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-3fc43a99-96e2-447b-8f4d-9ebc4716cdff req-04445973-69e7-40f9-a38a-4e3a0d8c06e5 service nova] Creating event network-changed:a195dea2-c192-44c9-a838-68ed16f657df for instance 1303e37f-ab18-42db-8f6f-dfe6580c7b0f on hv-cinder-84617 Jun 16 19:47:53.620753 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9204f5b1-d557-48b9-8348-c3e08cc649b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:53.621204 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9204f5b1-d557-48b9-8348-c3e08cc649b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:53.621987 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9204f5b1-d557-48b9-8348-c3e08cc649b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:53.622210 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-3fc43a99-96e2-447b-8f4d-9ebc4716cdff req-04445973-69e7-40f9-a38a-4e3a0d8c06e5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033240 Jun 16 19:47:53.622422 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9204f5b1-d557-48b9-8348-c3e08cc649b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:53.623154 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 312/646] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:47:53.762971 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9204f5b1-d557-48b9-8348-c3e08cc649b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:53.771256 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9204f5b1-d557-48b9-8348-c3e08cc649b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:53.772760 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9204f5b1-d557-48b9-8348-c3e08cc649b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:53.774453 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9204f5b1-d557-48b9-8348-c3e08cc649b2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.168285 Jun 16 19:47:53.775027 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 335/647] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:53 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:47:53.788318 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8b8e835b-402e-43a4-84b8-ac59337fb60b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:53.792910 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8b8e835b-402e-43a4-84b8-ac59337fb60b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:53.792910 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=4 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:53.796334 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b8e835b-402e-43a4-84b8-ac59337fb60b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:53.796728 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b8e835b-402e-43a4-84b8-ac59337fb60b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:53.797476 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b8e835b-402e-43a4-84b8-ac59337fb60b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:53.797900 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b8e835b-402e-43a4-84b8-ac59337fb60b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:53.827175 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8b8e835b-402e-43a4-84b8-ac59337fb60b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043011 Jun 16 19:47:53.827582 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 313/648] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:47:53 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:47:54.161762 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f32a047d-ea66-49f7-ad93-ccef2226f444 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:54.162389 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f32a047d-ea66-49f7-ad93-ccef2226f444 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:54.170788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f32a047d-ea66-49f7-ad93-ccef2226f444 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:54.170993 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2009ddb3-0de9-42c5-927b-44fc8cf86874 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:54.178819 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f32a047d-ea66-49f7-ad93-ccef2226f444 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:54.179016 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2009ddb3-0de9-42c5-927b-44fc8cf86874 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:54.179120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f32a047d-ea66-49f7-ad93-ccef2226f444 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:54.179120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f32a047d-ea66-49f7-ad93-ccef2226f444 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:54.179290 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2009ddb3-0de9-42c5-927b-44fc8cf86874 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:54.179290 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2009ddb3-0de9-42c5-927b-44fc8cf86874 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:54.179290 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2009ddb3-0de9-42c5-927b-44fc8cf86874 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:54.179290 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2009ddb3-0de9-42c5-927b-44fc8cf86874 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:54.302407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f32a047d-ea66-49f7-ad93-ccef2226f444 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:54.310379 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f32a047d-ea66-49f7-ad93-ccef2226f444 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.152528 Jun 16 19:47:54.311762 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2009ddb3-0de9-42c5-927b-44fc8cf86874 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:54.327347 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 336/649] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:54 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:54.327447 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2009ddb3-0de9-42c5-927b-44fc8cf86874 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.156235 Jun 16 19:47:54.327447 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 314/650] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:54 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:54.461115 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-75bd0e58-5bd1-40ba-9bf2-e0af34d6ce1e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:54.462205 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-75bd0e58-5bd1-40ba-9bf2-e0af34d6ce1e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:54.468304 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-75bd0e58-5bd1-40ba-9bf2-e0af34d6ce1e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:54.468966 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-75bd0e58-5bd1-40ba-9bf2-e0af34d6ce1e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:54.469729 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-75bd0e58-5bd1-40ba-9bf2-e0af34d6ce1e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:54.470161 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-75bd0e58-5bd1-40ba-9bf2-e0af34d6ce1e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:54.610230 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-75bd0e58-5bd1-40ba-9bf2-e0af34d6ce1e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:54.618108 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-75bd0e58-5bd1-40ba-9bf2-e0af34d6ce1e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.160506 Jun 16 19:47:54.618612 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 337/651] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:54 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:54.792955 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d5b980b3-20b2-4093-afd2-ff3323a362df tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:54.793566 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d5b980b3-20b2-4093-afd2-ff3323a362df tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:54.800351 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d5b980b3-20b2-4093-afd2-ff3323a362df tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:54.800351 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d5b980b3-20b2-4093-afd2-ff3323a362df tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:54.801002 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d5b980b3-20b2-4093-afd2-ff3323a362df tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:54.801439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d5b980b3-20b2-4093-afd2-ff3323a362df tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:54.838328 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bf564971-9cd4-4029-9809-cad1cbd51040 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:54.839459 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-bf564971-9cd4-4029-9809-cad1cbd51040 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:54.841770 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:54.846647 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bf564971-9cd4-4029-9809-cad1cbd51040 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:54.847130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bf564971-9cd4-4029-9809-cad1cbd51040 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:54.847904 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bf564971-9cd4-4029-9809-cad1cbd51040 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:54.848343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bf564971-9cd4-4029-9809-cad1cbd51040 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:54.879126 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-bf564971-9cd4-4029-9809-cad1cbd51040 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044634 Jun 16 19:47:54.879615 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 338/652] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:47:54 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:47:54.929875 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d5b980b3-20b2-4093-afd2-ff3323a362df tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:54.939144 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d5b980b3-20b2-4093-afd2-ff3323a362df tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:54.940649 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d5b980b3-20b2-4093-afd2-ff3323a362df tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:54.941803 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d5b980b3-20b2-4093-afd2-ff3323a362df tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.153159 Jun 16 19:47:54.942361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 315/653] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:54 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:55.326392 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-91e2fb34-03a6-45b7-8a90-04fe79e5bc32 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:55.327042 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-91e2fb34-03a6-45b7-8a90-04fe79e5bc32 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:55.333007 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-91e2fb34-03a6-45b7-8a90-04fe79e5bc32 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:55.333476 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-91e2fb34-03a6-45b7-8a90-04fe79e5bc32 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:55.334246 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-91e2fb34-03a6-45b7-8a90-04fe79e5bc32 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:55.334693 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-91e2fb34-03a6-45b7-8a90-04fe79e5bc32 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:55.342103 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a5477247-5788-4444-bd8a-3f0171152ff8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:55.342731 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a5477247-5788-4444-bd8a-3f0171152ff8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:55.344637 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=18 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:55.349370 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a5477247-5788-4444-bd8a-3f0171152ff8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:55.349814 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a5477247-5788-4444-bd8a-3f0171152ff8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:55.350579 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a5477247-5788-4444-bd8a-3f0171152ff8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:55.351039 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a5477247-5788-4444-bd8a-3f0171152ff8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:55.470259 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-91e2fb34-03a6-45b7-8a90-04fe79e5bc32 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:55.478796 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-91e2fb34-03a6-45b7-8a90-04fe79e5bc32 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.156157 Jun 16 19:47:55.479427 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 339/654] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:55 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:55.487180 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a5477247-5788-4444-bd8a-3f0171152ff8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:55.495416 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a5477247-5788-4444-bd8a-3f0171152ff8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.157226 Jun 16 19:47:55.495985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 316/655] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:55 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:55.638324 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d57d53c1-685a-47dc-8ab6-d08529a8534d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:55.638961 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d57d53c1-685a-47dc-8ab6-d08529a8534d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:55.644930 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d57d53c1-685a-47dc-8ab6-d08529a8534d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:55.645381 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d57d53c1-685a-47dc-8ab6-d08529a8534d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:55.646146 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d57d53c1-685a-47dc-8ab6-d08529a8534d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:55.646584 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d57d53c1-685a-47dc-8ab6-d08529a8534d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:55.773047 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d57d53c1-685a-47dc-8ab6-d08529a8534d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:55.781113 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d57d53c1-685a-47dc-8ab6-d08529a8534d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.149218 Jun 16 19:47:55.781683 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 340/656] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:55 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:55.890617 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c56041ed-b990-4fe0-9b94-218c2e1d08b0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:55.891557 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c56041ed-b990-4fe0-9b94-218c2e1d08b0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:55.898285 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c56041ed-b990-4fe0-9b94-218c2e1d08b0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:55.899421 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c56041ed-b990-4fe0-9b94-218c2e1d08b0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:55.900181 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c56041ed-b990-4fe0-9b94-218c2e1d08b0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:55.900611 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c56041ed-b990-4fe0-9b94-218c2e1d08b0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:55.932847 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c56041ed-b990-4fe0-9b94-218c2e1d08b0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046276 Jun 16 19:47:55.933452 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 317/657] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:47:55 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:47:55.961249 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e650e55e-4716-4a19-9216-2501be761eb7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:55.962367 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e650e55e-4716-4a19-9216-2501be761eb7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:55.969203 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e650e55e-4716-4a19-9216-2501be761eb7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:55.969653 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e650e55e-4716-4a19-9216-2501be761eb7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:55.970465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e650e55e-4716-4a19-9216-2501be761eb7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:55.970942 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e650e55e-4716-4a19-9216-2501be761eb7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:55.975091 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:56.101849 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e650e55e-4716-4a19-9216-2501be761eb7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:56.112425 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e650e55e-4716-4a19-9216-2501be761eb7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:56.114215 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e650e55e-4716-4a19-9216-2501be761eb7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:56.115227 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e650e55e-4716-4a19-9216-2501be761eb7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.158459 Jun 16 19:47:56.115798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 341/658] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:55 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:56.495987 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-62a822db-d596-4bba-9190-ae69f9656c01 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:56.496590 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-62a822db-d596-4bba-9190-ae69f9656c01 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:56.502711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-62a822db-d596-4bba-9190-ae69f9656c01 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:56.503176 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-62a822db-d596-4bba-9190-ae69f9656c01 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:56.503926 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-62a822db-d596-4bba-9190-ae69f9656c01 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:56.504353 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-62a822db-d596-4bba-9190-ae69f9656c01 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:56.513555 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0f29dc24-cfe8-4201-9125-6575ff7a6fbb tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:56.514165 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0f29dc24-cfe8-4201-9125-6575ff7a6fbb tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:56.520943 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0f29dc24-cfe8-4201-9125-6575ff7a6fbb tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:56.521388 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0f29dc24-cfe8-4201-9125-6575ff7a6fbb tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:56.522142 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0f29dc24-cfe8-4201-9125-6575ff7a6fbb tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:56.522570 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0f29dc24-cfe8-4201-9125-6575ff7a6fbb tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:56.639299 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-62a822db-d596-4bba-9190-ae69f9656c01 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:56.647234 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-62a822db-d596-4bba-9190-ae69f9656c01 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.155423 Jun 16 19:47:56.647793 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 318/659] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:56 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:56.666579 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0f29dc24-cfe8-4201-9125-6575ff7a6fbb tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:56.672539 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0f29dc24-cfe8-4201-9125-6575ff7a6fbb tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.163475 Jun 16 19:47:56.673176 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 342/660] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:56 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:56.797534 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7f034ed1-71bf-45a2-b25f-34a9eb5c09dc tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:56.798067 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7f034ed1-71bf-45a2-b25f-34a9eb5c09dc tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:56.804101 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7f034ed1-71bf-45a2-b25f-34a9eb5c09dc tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:56.804544 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7f034ed1-71bf-45a2-b25f-34a9eb5c09dc tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:56.805795 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7f034ed1-71bf-45a2-b25f-34a9eb5c09dc tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:56.806227 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7f034ed1-71bf-45a2-b25f-34a9eb5c09dc tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:56.937606 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7f034ed1-71bf-45a2-b25f-34a9eb5c09dc tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:56.944827 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f1a5818d-c134-4c32-867c-26589512d77a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:56.945446 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7f034ed1-71bf-45a2-b25f-34a9eb5c09dc tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.151739 Jun 16 19:47:56.946377 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f1a5818d-c134-4c32-867c-26589512d77a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:56.946714 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 319/661] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:56 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:56.952491 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f1a5818d-c134-4c32-867c-26589512d77a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:56.952943 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f1a5818d-c134-4c32-867c-26589512d77a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:56.953701 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f1a5818d-c134-4c32-867c-26589512d77a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:56.954134 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f1a5818d-c134-4c32-867c-26589512d77a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:56.982304 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f1a5818d-c134-4c32-867c-26589512d77a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041806 Jun 16 19:47:56.982974 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 343/662] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:47:56 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:47:57.134039 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b04dfc77-aaf4-4c9b-a514-63712fcfca73 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:57.134553 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b04dfc77-aaf4-4c9b-a514-63712fcfca73 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:57.142841 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b04dfc77-aaf4-4c9b-a514-63712fcfca73 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:57.143340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b04dfc77-aaf4-4c9b-a514-63712fcfca73 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:57.144090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b04dfc77-aaf4-4c9b-a514-63712fcfca73 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:57.144691 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b04dfc77-aaf4-4c9b-a514-63712fcfca73 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:57.277603 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b04dfc77-aaf4-4c9b-a514-63712fcfca73 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:57.285894 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b04dfc77-aaf4-4c9b-a514-63712fcfca73 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:57.287407 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b04dfc77-aaf4-4c9b-a514-63712fcfca73 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:57.288548 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b04dfc77-aaf4-4c9b-a514-63712fcfca73 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.159173 Jun 16 19:47:57.289099 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 320/663] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:57 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:57.684779 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-78894591-855f-44e4-bd98-d6a141afdc49 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:57.689451 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-78894591-855f-44e4-bd98-d6a141afdc49 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:57.689570 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-81359f9b-a044-4e1c-ac4a-7a95171ff5d0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:57.690001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-81359f9b-a044-4e1c-ac4a-7a95171ff5d0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:57.692208 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-78894591-855f-44e4-bd98-d6a141afdc49 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:57.692643 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-78894591-855f-44e4-bd98-d6a141afdc49 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:57.693691 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-78894591-855f-44e4-bd98-d6a141afdc49 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:57.694105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-78894591-855f-44e4-bd98-d6a141afdc49 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:57.697231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-81359f9b-a044-4e1c-ac4a-7a95171ff5d0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:57.697679 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-81359f9b-a044-4e1c-ac4a-7a95171ff5d0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:57.698502 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-81359f9b-a044-4e1c-ac4a-7a95171ff5d0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:57.698947 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-81359f9b-a044-4e1c-ac4a-7a95171ff5d0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:57.827768 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-78894591-855f-44e4-bd98-d6a141afdc49 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:57.830232 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-81359f9b-a044-4e1c-ac4a-7a95171ff5d0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:57.835404 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-78894591-855f-44e4-bd98-d6a141afdc49 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.157819 Jun 16 19:47:57.838451 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 344/664] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:57 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:57.841947 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-81359f9b-a044-4e1c-ac4a-7a95171ff5d0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.156316 Jun 16 19:47:57.842912 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 321/665] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:57 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:57.963171 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1cdde0ae-72be-48a2-b9fb-de88fee38359 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:57.963779 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-1cdde0ae-72be-48a2-b9fb-de88fee38359 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:57.970122 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1cdde0ae-72be-48a2-b9fb-de88fee38359 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:57.970654 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1cdde0ae-72be-48a2-b9fb-de88fee38359 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:57.971455 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1cdde0ae-72be-48a2-b9fb-de88fee38359 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:57.971893 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1cdde0ae-72be-48a2-b9fb-de88fee38359 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:57.993593 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-942aa4a0-6319-491a-a927-f7fa96e71ae5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:57.994562 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-942aa4a0-6319-491a-a927-f7fa96e71ae5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:58.000462 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-942aa4a0-6319-491a-a927-f7fa96e71ae5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:58.000892 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-942aa4a0-6319-491a-a927-f7fa96e71ae5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:58.001639 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-942aa4a0-6319-491a-a927-f7fa96e71ae5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:58.002065 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-942aa4a0-6319-491a-a927-f7fa96e71ae5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:58.027740 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:58.032102 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-942aa4a0-6319-491a-a927-f7fa96e71ae5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042448 Jun 16 19:47:58.032671 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 322/666] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:47:57 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:47:58.099357 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1cdde0ae-72be-48a2-b9fb-de88fee38359 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:58.106855 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-1cdde0ae-72be-48a2-b9fb-de88fee38359 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.148100 Jun 16 19:47:58.107797 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 345/667] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:57 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:58.307682 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-dbbd0e1b-2ce1-46d2-a431-3335da5bde5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:58.308290 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-dbbd0e1b-2ce1-46d2-a431-3335da5bde5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:58.310081 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:DELETE=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:47:58.314746 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dbbd0e1b-2ce1-46d2-a431-3335da5bde5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:58.315227 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dbbd0e1b-2ce1-46d2-a431-3335da5bde5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:58.315989 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dbbd0e1b-2ce1-46d2-a431-3335da5bde5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:58.316424 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dbbd0e1b-2ce1-46d2-a431-3335da5bde5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:58.448536 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-dbbd0e1b-2ce1-46d2-a431-3335da5bde5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:58.457189 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-dbbd0e1b-2ce1-46d2-a431-3335da5bde5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:58.458661 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-dbbd0e1b-2ce1-46d2-a431-3335da5bde5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:58.459835 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-dbbd0e1b-2ce1-46d2-a431-3335da5bde5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.156620 Jun 16 19:47:58.460377 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 323/668] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:58 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:47:58.852724 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b923ce26-13cb-46a6-b69c-909723572f75 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:58.854387 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b923ce26-13cb-46a6-b69c-909723572f75 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:58.859158 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-757e9c34-72e2-4fee-9f22-5d2a407d1e5f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:58.859765 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-757e9c34-72e2-4fee-9f22-5d2a407d1e5f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:58.860355 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b923ce26-13cb-46a6-b69c-909723572f75 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:58.860807 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b923ce26-13cb-46a6-b69c-909723572f75 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:58.861573 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b923ce26-13cb-46a6-b69c-909723572f75 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:58.862170 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b923ce26-13cb-46a6-b69c-909723572f75 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:58.866849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-757e9c34-72e2-4fee-9f22-5d2a407d1e5f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:58.867322 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-757e9c34-72e2-4fee-9f22-5d2a407d1e5f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:58.868084 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-757e9c34-72e2-4fee-9f22-5d2a407d1e5f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:58.868516 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-757e9c34-72e2-4fee-9f22-5d2a407d1e5f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:58.993648 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b923ce26-13cb-46a6-b69c-909723572f75 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:58.995966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-757e9c34-72e2-4fee-9f22-5d2a407d1e5f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:59.001218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b923ce26-13cb-46a6-b69c-909723572f75 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.152427 Jun 16 19:47:59.001790 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 346/669] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:58 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:59.003976 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-757e9c34-72e2-4fee-9f22-5d2a407d1e5f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.148482 Jun 16 19:47:59.004528 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 324/670] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:58 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:47:59.042911 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8776ed4c-75f8-4e5c-972e-50684c2669af tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:59.043919 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8776ed4c-75f8-4e5c-972e-50684c2669af tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:59.049977 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8776ed4c-75f8-4e5c-972e-50684c2669af tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:59.050425 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8776ed4c-75f8-4e5c-972e-50684c2669af tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:59.051221 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8776ed4c-75f8-4e5c-972e-50684c2669af tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:59.051659 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8776ed4c-75f8-4e5c-972e-50684c2669af tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:59.082187 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8776ed4c-75f8-4e5c-972e-50684c2669af tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043080 Jun 16 19:47:59.082741 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 347/671] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:47:59 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:47:59.124698 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-57489dc8-31da-40e4-b26a-d689e243361e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:59.125367 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-57489dc8-31da-40e4-b26a-d689e243361e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:59.131623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-57489dc8-31da-40e4-b26a-d689e243361e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:59.132070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-57489dc8-31da-40e4-b26a-d689e243361e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:59.132825 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-57489dc8-31da-40e4-b26a-d689e243361e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:59.133874 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-57489dc8-31da-40e4-b26a-d689e243361e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:59.263042 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-57489dc8-31da-40e4-b26a-d689e243361e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:59.270455 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-57489dc8-31da-40e4-b26a-d689e243361e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.149933 Jun 16 19:47:59.271035 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 325/672] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:47:59 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:47:59.479180 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d3a56113-891f-4083-868f-bbb85f905848 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:47:59.479791 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d3a56113-891f-4083-868f-bbb85f905848 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:47:59.485677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d3a56113-891f-4083-868f-bbb85f905848 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:59.486127 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d3a56113-891f-4083-868f-bbb85f905848 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:59.486876 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d3a56113-891f-4083-868f-bbb85f905848 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:47:59.487331 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d3a56113-891f-4083-868f-bbb85f905848 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:47:59.615458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d3a56113-891f-4083-868f-bbb85f905848 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:59.624550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d3a56113-891f-4083-868f-bbb85f905848 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:59.626070 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d3a56113-891f-4083-868f-bbb85f905848 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:47:59.631398 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d3a56113-891f-4083-868f-bbb85f905848 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.152518 Jun 16 19:47:59.631398 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 348/673] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:47:59 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:48:00.026373 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3dcd7e78-5711-4158-ab01-76afdf23cb8c tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:00.026877 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5e2ada21-f0f3-4e74-9145-3c8dc3b969b4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:00.027013 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3dcd7e78-5711-4158-ab01-76afdf23cb8c tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:00.027455 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5e2ada21-f0f3-4e74-9145-3c8dc3b969b4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:00.032848 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3dcd7e78-5711-4158-ab01-76afdf23cb8c tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:00.033288 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3dcd7e78-5711-4158-ab01-76afdf23cb8c tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:00.033635 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5e2ada21-f0f3-4e74-9145-3c8dc3b969b4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:00.034067 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3dcd7e78-5711-4158-ab01-76afdf23cb8c tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:00.034180 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5e2ada21-f0f3-4e74-9145-3c8dc3b969b4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:00.034494 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3dcd7e78-5711-4158-ab01-76afdf23cb8c tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:00.034834 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5e2ada21-f0f3-4e74-9145-3c8dc3b969b4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:00.035299 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5e2ada21-f0f3-4e74-9145-3c8dc3b969b4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:00.166235 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3dcd7e78-5711-4158-ab01-76afdf23cb8c tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:00.170807 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3dcd7e78-5711-4158-ab01-76afdf23cb8c tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.148842 Jun 16 19:48:00.171293 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5e2ada21-f0f3-4e74-9145-3c8dc3b969b4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:00.171412 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 326/674] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:00 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:00.177040 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3b52ef18-4b3d-4f0a-8545-4b71ff551299 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:00.178019 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3b52ef18-4b3d-4f0a-8545-4b71ff551299 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:00.184061 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3b52ef18-4b3d-4f0a-8545-4b71ff551299 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:00.184500 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3b52ef18-4b3d-4f0a-8545-4b71ff551299 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:00.185260 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3b52ef18-4b3d-4f0a-8545-4b71ff551299 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:00.185689 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3b52ef18-4b3d-4f0a-8545-4b71ff551299 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:00.188104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5e2ada21-f0f3-4e74-9145-3c8dc3b969b4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.165717 Jun 16 19:48:00.194421 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 349/675] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:00 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:00.215871 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3b52ef18-4b3d-4f0a-8545-4b71ff551299 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043480 Jun 16 19:48:00.216428 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 327/676] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:00 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:00.287040 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d8ca9d3c-b3e1-4d12-b6b0-c28412e60340 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:00.287702 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d8ca9d3c-b3e1-4d12-b6b0-c28412e60340 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:00.293674 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d8ca9d3c-b3e1-4d12-b6b0-c28412e60340 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:00.294128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d8ca9d3c-b3e1-4d12-b6b0-c28412e60340 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:00.294883 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d8ca9d3c-b3e1-4d12-b6b0-c28412e60340 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:00.295352 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d8ca9d3c-b3e1-4d12-b6b0-c28412e60340 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:00.429448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d8ca9d3c-b3e1-4d12-b6b0-c28412e60340 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:00.436791 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d8ca9d3c-b3e1-4d12-b6b0-c28412e60340 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.153611 Jun 16 19:48:00.437356 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 350/677] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:00 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:00.644972 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e554664c-6537-4d67-b458-21289990cf90 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:00.645582 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e554664c-6537-4d67-b458-21289990cf90 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:00.651506 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e554664c-6537-4d67-b458-21289990cf90 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:00.651956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e554664c-6537-4d67-b458-21289990cf90 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:00.652722 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e554664c-6537-4d67-b458-21289990cf90 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:00.653156 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e554664c-6537-4d67-b458-21289990cf90 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:00.746776 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-e287a857-03bb-41ac-b756-5f82edf6c293 req-6acd8d35-3c04-4a88-ba0c-a4d3a76d95cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f667dde1-232e-4f14-917f-0a749279d6a8", "name": "network-vif-plugged", "status": "completed", "tag": "ce7582ec-7186-425a-a407-f177022e1f52"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:48:00.763635 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-e287a857-03bb-41ac-b756-5f82edf6c293 req-6acd8d35-3c04-4a88-ba0c-a4d3a76d95cb service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:00.763635 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-e287a857-03bb-41ac-b756-5f82edf6c293 req-6acd8d35-3c04-4a88-ba0c-a4d3a76d95cb service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:00.771730 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-e287a857-03bb-41ac-b756-5f82edf6c293 req-6acd8d35-3c04-4a88-ba0c-a4d3a76d95cb service nova] Creating event network-vif-plugged:ce7582ec-7186-425a-a407-f177022e1f52 for instance f667dde1-232e-4f14-917f-0a749279d6a8 on hv-cinder-84617 Jun 16 19:48:00.777451 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-e287a857-03bb-41ac-b756-5f82edf6c293 req-6acd8d35-3c04-4a88-ba0c-a4d3a76d95cb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035920 Jun 16 19:48:00.778127 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 351/678] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:00.915424 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e554664c-6537-4d67-b458-21289990cf90 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:00.925161 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e554664c-6537-4d67-b458-21289990cf90 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:00.926713 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e554664c-6537-4d67-b458-21289990cf90 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:00.927860 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e554664c-6537-4d67-b458-21289990cf90 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.286808 Jun 16 19:48:00.928619 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 328/679] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:48:00 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:48:01.188802 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f8e27502-7ca8-44d5-ba13-c529d9527064 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:01.189742 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f8e27502-7ca8-44d5-ba13-c529d9527064 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:01.196481 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f8e27502-7ca8-44d5-ba13-c529d9527064 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:01.197010 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f8e27502-7ca8-44d5-ba13-c529d9527064 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:01.197853 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f8e27502-7ca8-44d5-ba13-c529d9527064 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:01.198295 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f8e27502-7ca8-44d5-ba13-c529d9527064 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:01.209873 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-79aef336-c3fa-4477-9480-8e04ab2aa1cc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:01.212230 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-79aef336-c3fa-4477-9480-8e04ab2aa1cc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:01.220148 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-79aef336-c3fa-4477-9480-8e04ab2aa1cc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:01.222313 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-79aef336-c3fa-4477-9480-8e04ab2aa1cc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:01.223395 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-79aef336-c3fa-4477-9480-8e04ab2aa1cc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:01.223839 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-79aef336-c3fa-4477-9480-8e04ab2aa1cc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:01.354765 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f8e27502-7ca8-44d5-ba13-c529d9527064 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:01.374810 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f8e27502-7ca8-44d5-ba13-c529d9527064 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.191103 Jun 16 19:48:01.380584 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-79aef336-c3fa-4477-9480-8e04ab2aa1cc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:01.384478 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 352/680] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:01 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:01.390340 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-867b28c7-f1ce-42c6-9c18-f0d95b59f344 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:01.391190 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-79aef336-c3fa-4477-9480-8e04ab2aa1cc tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.185176 Jun 16 19:48:01.391855 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 329/681] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:01 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:01.392026 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-867b28c7-f1ce-42c6-9c18-f0d95b59f344 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:01.399428 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-867b28c7-f1ce-42c6-9c18-f0d95b59f344 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:01.400104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-867b28c7-f1ce-42c6-9c18-f0d95b59f344 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:01.401059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-867b28c7-f1ce-42c6-9c18-f0d95b59f344 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:01.401883 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-867b28c7-f1ce-42c6-9c18-f0d95b59f344 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:01.438955 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-867b28c7-f1ce-42c6-9c18-f0d95b59f344 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053018 Jun 16 19:48:01.439647 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 353/682] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:01 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:01.454602 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-054dd64f-9427-4a8c-aa45-336dbc9a618a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:01.455248 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-054dd64f-9427-4a8c-aa45-336dbc9a618a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:01.461756 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-054dd64f-9427-4a8c-aa45-336dbc9a618a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:01.462200 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-054dd64f-9427-4a8c-aa45-336dbc9a618a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:01.462976 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-054dd64f-9427-4a8c-aa45-336dbc9a618a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:01.463413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-054dd64f-9427-4a8c-aa45-336dbc9a618a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:01.665884 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-054dd64f-9427-4a8c-aa45-336dbc9a618a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:01.673725 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-054dd64f-9427-4a8c-aa45-336dbc9a618a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.222971 Jun 16 19:48:01.674222 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 330/683] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:01 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:01.946697 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-dc9307f2-cbbf-4a6d-9f8b-f25976dbbe0e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:01.947329 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-dc9307f2-cbbf-4a6d-9f8b-f25976dbbe0e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:01.953211 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-dc9307f2-cbbf-4a6d-9f8b-f25976dbbe0e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:01.953655 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-dc9307f2-cbbf-4a6d-9f8b-f25976dbbe0e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:01.954405 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-dc9307f2-cbbf-4a6d-9f8b-f25976dbbe0e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:01.954831 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-dc9307f2-cbbf-4a6d-9f8b-f25976dbbe0e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:02.086724 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-dc9307f2-cbbf-4a6d-9f8b-f25976dbbe0e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:02.095056 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-dc9307f2-cbbf-4a6d-9f8b-f25976dbbe0e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:02.096582 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-dc9307f2-cbbf-4a6d-9f8b-f25976dbbe0e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:02.097718 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-dc9307f2-cbbf-4a6d-9f8b-f25976dbbe0e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.155227 Jun 16 19:48:02.098264 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 354/684] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:48:01 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:48:02.390826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-488ccbe1-ee6f-4e0e-9445-7393a33e1b4f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:02.391456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-488ccbe1-ee6f-4e0e-9445-7393a33e1b4f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:02.397455 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-488ccbe1-ee6f-4e0e-9445-7393a33e1b4f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:02.397899 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-488ccbe1-ee6f-4e0e-9445-7393a33e1b4f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:02.398667 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-488ccbe1-ee6f-4e0e-9445-7393a33e1b4f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:02.399129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-488ccbe1-ee6f-4e0e-9445-7393a33e1b4f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:02.408827 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-14267296-e266-459a-96f0-a577be1c0fcf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:02.409431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-14267296-e266-459a-96f0-a577be1c0fcf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:02.416514 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-14267296-e266-459a-96f0-a577be1c0fcf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:02.416998 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-14267296-e266-459a-96f0-a577be1c0fcf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:02.417722 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-14267296-e266-459a-96f0-a577be1c0fcf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:02.418148 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-14267296-e266-459a-96f0-a577be1c0fcf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:02.548102 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-488ccbe1-ee6f-4e0e-9445-7393a33e1b4f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:02.556273 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-488ccbe1-ee6f-4e0e-9445-7393a33e1b4f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.168707 Jun 16 19:48:02.565869 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 331/685] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:02 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:02.571693 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-04e320e8-a209-4663-8995-957ae1b08d65 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:02.572802 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-04e320e8-a209-4663-8995-957ae1b08d65 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:02.578806 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-04e320e8-a209-4663-8995-957ae1b08d65 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:02.579305 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-04e320e8-a209-4663-8995-957ae1b08d65 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:02.580071 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-04e320e8-a209-4663-8995-957ae1b08d65 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:02.580507 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-04e320e8-a209-4663-8995-957ae1b08d65 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:02.581864 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-14267296-e266-459a-96f0-a577be1c0fcf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:02.590383 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-14267296-e266-459a-96f0-a577be1c0fcf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.185246 Jun 16 19:48:02.590993 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 355/686] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:02 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:02.622902 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-04e320e8-a209-4663-8995-957ae1b08d65 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044118 Jun 16 19:48:02.622902 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 332/687] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:02 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:02.691351 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-65974a03-ca44-462f-ac20-5d8bd88f17ed tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:02.691972 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-65974a03-ca44-462f-ac20-5d8bd88f17ed tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:02.701131 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-65974a03-ca44-462f-ac20-5d8bd88f17ed tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:02.701504 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-65974a03-ca44-462f-ac20-5d8bd88f17ed tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:02.702461 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-65974a03-ca44-462f-ac20-5d8bd88f17ed tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:02.703078 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-65974a03-ca44-462f-ac20-5d8bd88f17ed tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:02.792688 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-81717609-c3ca-44e8-999f-6f14cabaea2c req-8c22d212-4c59-40c4-9814-d76189552c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e487bec-d93f-4777-a2df-96eab8459319", "name": "network-vif-plugged", "status": "completed", "tag": "0d5544ee-f9fd-469d-8be9-aae37bba47b9"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:48:02.800713 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-81717609-c3ca-44e8-999f-6f14cabaea2c req-8c22d212-4c59-40c4-9814-d76189552c38 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:02.801080 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-81717609-c3ca-44e8-999f-6f14cabaea2c req-8c22d212-4c59-40c4-9814-d76189552c38 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:02.812154 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-81717609-c3ca-44e8-999f-6f14cabaea2c req-8c22d212-4c59-40c4-9814-d76189552c38 service nova] Creating event network-vif-plugged:0d5544ee-f9fd-469d-8be9-aae37bba47b9 for instance 8e487bec-d93f-4777-a2df-96eab8459319 on hv-cinder-84617 Jun 16 19:48:02.817867 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-81717609-c3ca-44e8-999f-6f14cabaea2c req-8c22d212-4c59-40c4-9814-d76189552c38 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029409 Jun 16 19:48:02.819100 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 333/688] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:48:02.843002 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-65974a03-ca44-462f-ac20-5d8bd88f17ed tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:02.850640 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-65974a03-ca44-462f-ac20-5d8bd88f17ed tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.163254 Jun 16 19:48:02.851237 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 356/689] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:02 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:03.079378 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-385b25f3-6387-4f77-aad6-3242b6b04ab0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:03.080075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-385b25f3-6387-4f77-aad6-3242b6b04ab0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:03.086205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-385b25f3-6387-4f77-aad6-3242b6b04ab0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:03.086661 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-385b25f3-6387-4f77-aad6-3242b6b04ab0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:03.087452 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-385b25f3-6387-4f77-aad6-3242b6b04ab0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:03.087892 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-385b25f3-6387-4f77-aad6-3242b6b04ab0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:03.117950 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-35a3ccdc-2bdf-4070-b12d-a5df2517afae tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:03.118629 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-35a3ccdc-2bdf-4070-b12d-a5df2517afae tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:03.124738 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-35a3ccdc-2bdf-4070-b12d-a5df2517afae tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:03.125191 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-35a3ccdc-2bdf-4070-b12d-a5df2517afae tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:03.125960 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-35a3ccdc-2bdf-4070-b12d-a5df2517afae tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:03.126397 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-35a3ccdc-2bdf-4070-b12d-a5df2517afae tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:03.230902 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-385b25f3-6387-4f77-aad6-3242b6b04ab0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:03.239178 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-385b25f3-6387-4f77-aad6-3242b6b04ab0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1592 microversion: 2.1 time: 0.163901 Jun 16 19:48:03.239750 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 334/690] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:03 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1592 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:03.265647 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-35a3ccdc-2bdf-4070-b12d-a5df2517afae tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:03.276014 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-35a3ccdc-2bdf-4070-b12d-a5df2517afae tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:03.280166 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-35a3ccdc-2bdf-4070-b12d-a5df2517afae tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:03.280166 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-35a3ccdc-2bdf-4070-b12d-a5df2517afae tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.165349 Jun 16 19:48:03.280166 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 357/691] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:48:03 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:48:03.572825 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-815d2718-0bc2-4d74-82f1-e5a32e8f10a3 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:03.573341 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-815d2718-0bc2-4d74-82f1-e5a32e8f10a3 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:03.579349 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-815d2718-0bc2-4d74-82f1-e5a32e8f10a3 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:03.579799 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-815d2718-0bc2-4d74-82f1-e5a32e8f10a3 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:03.580558 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-815d2718-0bc2-4d74-82f1-e5a32e8f10a3 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:03.580988 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-815d2718-0bc2-4d74-82f1-e5a32e8f10a3 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:03.608453 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-812d08cc-1514-4649-8e1c-2a4824c68437 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:03.609063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-812d08cc-1514-4649-8e1c-2a4824c68437 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:03.615875 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-812d08cc-1514-4649-8e1c-2a4824c68437 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:03.616516 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-812d08cc-1514-4649-8e1c-2a4824c68437 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:03.617368 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-812d08cc-1514-4649-8e1c-2a4824c68437 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:03.617802 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-812d08cc-1514-4649-8e1c-2a4824c68437 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:03.636170 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:03.754233 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-812d08cc-1514-4649-8e1c-2a4824c68437 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:03.769462 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-812d08cc-1514-4649-8e1c-2a4824c68437 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.165165 Jun 16 19:48:03.770663 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 358/692] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:03 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:03.775529 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c0c5cf4c-6894-429f-aa9e-482e73543b21 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:03.777145 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c0c5cf4c-6894-429f-aa9e-482e73543b21 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:03.783649 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c0c5cf4c-6894-429f-aa9e-482e73543b21 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:03.784336 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c0c5cf4c-6894-429f-aa9e-482e73543b21 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:03.785108 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c0c5cf4c-6894-429f-aa9e-482e73543b21 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:03.785546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c0c5cf4c-6894-429f-aa9e-482e73543b21 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:03.799296 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-815d2718-0bc2-4d74-82f1-e5a32e8f10a3 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:03.808342 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-815d2718-0bc2-4d74-82f1-e5a32e8f10a3 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.239337 Jun 16 19:48:03.809004 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 335/693] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:03 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:03.818069 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c0c5cf4c-6894-429f-aa9e-482e73543b21 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044857 Jun 16 19:48:03.818069 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 359/694] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:03 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:03.867775 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-00eb1d3b-983e-4a60-b681-a33576089a36 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:03.868503 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-00eb1d3b-983e-4a60-b681-a33576089a36 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:03.874376 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-00eb1d3b-983e-4a60-b681-a33576089a36 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:03.874887 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-00eb1d3b-983e-4a60-b681-a33576089a36 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:03.875671 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-00eb1d3b-983e-4a60-b681-a33576089a36 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:03.876098 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-00eb1d3b-983e-4a60-b681-a33576089a36 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:04.015118 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-00eb1d3b-983e-4a60-b681-a33576089a36 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:04.018671 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-00eb1d3b-983e-4a60-b681-a33576089a36 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.154562 Jun 16 19:48:04.019278 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 360/695] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:03 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:04.305199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-91a6b379-5417-4a21-9dd2-7612c77704af tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:04.305809 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-91a6b379-5417-4a21-9dd2-7612c77704af tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:04.312024 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-91a6b379-5417-4a21-9dd2-7612c77704af tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:04.312480 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-91a6b379-5417-4a21-9dd2-7612c77704af tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:04.313279 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-91a6b379-5417-4a21-9dd2-7612c77704af tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:04.313714 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-91a6b379-5417-4a21-9dd2-7612c77704af tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:04.753069 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-91a6b379-5417-4a21-9dd2-7612c77704af tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:04.762236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-91a6b379-5417-4a21-9dd2-7612c77704af tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:04.763850 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-91a6b379-5417-4a21-9dd2-7612c77704af tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:04.765003 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-91a6b379-5417-4a21-9dd2-7612c77704af tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.471359 Jun 16 19:48:04.765555 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 336/696] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:48:04 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:48:04.787336 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-796ecf7c-e2a6-4e3c-aae2-bc3e36a0f8b0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:04.787943 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-796ecf7c-e2a6-4e3c-aae2-bc3e36a0f8b0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:04.794529 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-796ecf7c-e2a6-4e3c-aae2-bc3e36a0f8b0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:04.795006 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-796ecf7c-e2a6-4e3c-aae2-bc3e36a0f8b0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:04.795768 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-796ecf7c-e2a6-4e3c-aae2-bc3e36a0f8b0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:04.796200 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-796ecf7c-e2a6-4e3c-aae2-bc3e36a0f8b0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:04.843224 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-342b83b2-6a0d-4886-b2a8-85aab9556c1b tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:04.843224 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-342b83b2-6a0d-4886-b2a8-85aab9556c1b tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:04.843224 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-342b83b2-6a0d-4886-b2a8-85aab9556c1b tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:04.843224 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-342b83b2-6a0d-4886-b2a8-85aab9556c1b tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:04.843719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-342b83b2-6a0d-4886-b2a8-85aab9556c1b tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:04.843719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-342b83b2-6a0d-4886-b2a8-85aab9556c1b tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:04.929045 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-796ecf7c-e2a6-4e3c-aae2-bc3e36a0f8b0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:04.937980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-796ecf7c-e2a6-4e3c-aae2-bc3e36a0f8b0 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.154244 Jun 16 19:48:04.938559 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 361/697] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:04 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:04.943661 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-24ee733d-abe2-4392-b56e-8ab629992fbc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:04.944612 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-24ee733d-abe2-4392-b56e-8ab629992fbc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:04.951103 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-24ee733d-abe2-4392-b56e-8ab629992fbc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:04.951588 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-24ee733d-abe2-4392-b56e-8ab629992fbc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:04.952938 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-24ee733d-abe2-4392-b56e-8ab629992fbc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:04.953177 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-24ee733d-abe2-4392-b56e-8ab629992fbc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:04.983712 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-24ee733d-abe2-4392-b56e-8ab629992fbc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043954 Jun 16 19:48:04.984282 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 362/698] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:04 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:05.036434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d6c6cf3a-2c6d-496e-9137-e6fb4304b70a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:05.037048 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d6c6cf3a-2c6d-496e-9137-e6fb4304b70a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:05.043421 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d6c6cf3a-2c6d-496e-9137-e6fb4304b70a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:05.043841 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d6c6cf3a-2c6d-496e-9137-e6fb4304b70a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:05.045196 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d6c6cf3a-2c6d-496e-9137-e6fb4304b70a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:05.045634 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d6c6cf3a-2c6d-496e-9137-e6fb4304b70a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:05.104117 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-342b83b2-6a0d-4886-b2a8-85aab9556c1b tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:05.111913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-342b83b2-6a0d-4886-b2a8-85aab9556c1b tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.289463 Jun 16 19:48:05.112493 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 337/699] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:04 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:05.194837 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d6c6cf3a-2c6d-496e-9137-e6fb4304b70a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:05.202807 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d6c6cf3a-2c6d-496e-9137-e6fb4304b70a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.170274 Jun 16 19:48:05.203465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 363/700] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:05 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:05.783658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-767cdda3-2dc0-4179-9be1-ff945894d71c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:05.784403 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-767cdda3-2dc0-4179-9be1-ff945894d71c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:05.790341 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-767cdda3-2dc0-4179-9be1-ff945894d71c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:05.790859 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-767cdda3-2dc0-4179-9be1-ff945894d71c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:05.791706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-767cdda3-2dc0-4179-9be1-ff945894d71c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:05.792231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-767cdda3-2dc0-4179-9be1-ff945894d71c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:05.955565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e1142e55-e726-427e-84f5-dd6e5d09da6b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:05.956175 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e1142e55-e726-427e-84f5-dd6e5d09da6b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:05.962646 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e1142e55-e726-427e-84f5-dd6e5d09da6b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:05.963135 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e1142e55-e726-427e-84f5-dd6e5d09da6b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:05.965672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e1142e55-e726-427e-84f5-dd6e5d09da6b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:05.965672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e1142e55-e726-427e-84f5-dd6e5d09da6b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:05.977927 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-767cdda3-2dc0-4179-9be1-ff945894d71c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:05.990657 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-767cdda3-2dc0-4179-9be1-ff945894d71c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:05.993875 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-767cdda3-2dc0-4179-9be1-ff945894d71c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:05.995826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-767cdda3-2dc0-4179-9be1-ff945894d71c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.215895 Jun 16 19:48:05.996776 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 338/701] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:48:05 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:48:06.004130 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c3ef7078-5e5b-401d-a7a8-44ba8eebf686 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:06.005982 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c3ef7078-5e5b-401d-a7a8-44ba8eebf686 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:06.015753 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c3ef7078-5e5b-401d-a7a8-44ba8eebf686 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:06.016679 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c3ef7078-5e5b-401d-a7a8-44ba8eebf686 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:06.017955 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c3ef7078-5e5b-401d-a7a8-44ba8eebf686 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:06.018739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c3ef7078-5e5b-401d-a7a8-44ba8eebf686 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:06.062205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c3ef7078-5e5b-401d-a7a8-44ba8eebf686 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063773 Jun 16 19:48:06.062792 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 339/702] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:05 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:06.116906 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e1142e55-e726-427e-84f5-dd6e5d09da6b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:06.125353 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e1142e55-e726-427e-84f5-dd6e5d09da6b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.173541 Jun 16 19:48:06.125852 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 364/703] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:05 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:06.130469 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-77b12b3f-3098-4833-8715-9223c6b55fe2 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:06.131137 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-77b12b3f-3098-4833-8715-9223c6b55fe2 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:06.139625 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-77b12b3f-3098-4833-8715-9223c6b55fe2 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:06.140092 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-77b12b3f-3098-4833-8715-9223c6b55fe2 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:06.140828 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-77b12b3f-3098-4833-8715-9223c6b55fe2 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:06.141265 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-77b12b3f-3098-4833-8715-9223c6b55fe2 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:06.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:06.220118 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8199f7be-bad1-4d28-813c-07a690653349 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:06.220849 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8199f7be-bad1-4d28-813c-07a690653349 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:06.227801 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8199f7be-bad1-4d28-813c-07a690653349 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:06.228381 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8199f7be-bad1-4d28-813c-07a690653349 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:06.229287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8199f7be-bad1-4d28-813c-07a690653349 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:06.229830 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8199f7be-bad1-4d28-813c-07a690653349 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:06.310201 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-77b12b3f-3098-4833-8715-9223c6b55fe2 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:06.322257 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-77b12b3f-3098-4833-8715-9223c6b55fe2 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.196197 Jun 16 19:48:06.323217 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 340/704] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:06 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:06.331239 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-8f2f7c0f-6403-48f4-bf9f-44efc842983a req-d7a1f9a3-4214-4bc4-8d09-6f6286522d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf542d63-f9a6-4101-a1a0-be5fff525e1e", "tag": "8b0eb30b-d9a5-4b32-a7b4-cff5a9a46047"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:48:06.341588 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-8f2f7c0f-6403-48f4-bf9f-44efc842983a req-d7a1f9a3-4214-4bc4-8d09-6f6286522d58 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:06.347779 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-8f2f7c0f-6403-48f4-bf9f-44efc842983a req-d7a1f9a3-4214-4bc4-8d09-6f6286522d58 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:06.355863 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-8f2f7c0f-6403-48f4-bf9f-44efc842983a req-d7a1f9a3-4214-4bc4-8d09-6f6286522d58 service nova] Creating event network-changed:8b0eb30b-d9a5-4b32-a7b4-cff5a9a46047 for instance bf542d63-f9a6-4101-a1a0-be5fff525e1e on hv-cinder-84617 Jun 16 19:48:06.361015 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-8f2f7c0f-6403-48f4-bf9f-44efc842983a req-d7a1f9a3-4214-4bc4-8d09-6f6286522d58 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036179 Jun 16 19:48:06.361701 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 341/705] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:06.394401 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8199f7be-bad1-4d28-813c-07a690653349 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:06.404686 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8199f7be-bad1-4d28-813c-07a690653349 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.188411 Jun 16 19:48:06.411060 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 365/706] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:06 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:07.014779 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-86791536-4fa7-474c-b5ea-1d174855f119 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:07.015638 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-86791536-4fa7-474c-b5ea-1d174855f119 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:07.022567 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86791536-4fa7-474c-b5ea-1d174855f119 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:07.023135 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86791536-4fa7-474c-b5ea-1d174855f119 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:07.024506 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86791536-4fa7-474c-b5ea-1d174855f119 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:07.025006 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86791536-4fa7-474c-b5ea-1d174855f119 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:07.077678 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a1e66d16-1547-4d40-b10a-dd079606ca76 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:07.079297 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a1e66d16-1547-4d40-b10a-dd079606ca76 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:07.091683 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1e66d16-1547-4d40-b10a-dd079606ca76 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:07.093488 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1e66d16-1547-4d40-b10a-dd079606ca76 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:07.093842 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1e66d16-1547-4d40-b10a-dd079606ca76 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:07.094279 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1e66d16-1547-4d40-b10a-dd079606ca76 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:07.140204 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a1e66d16-1547-4d40-b10a-dd079606ca76 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063187 Jun 16 19:48:07.145163 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 366/707] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:07 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:48:07.150504 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-37c5ceb7-3303-4681-a1f4-1bfe69e90b37 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:07.151373 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-37c5ceb7-3303-4681-a1f4-1bfe69e90b37 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:07.159805 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-37c5ceb7-3303-4681-a1f4-1bfe69e90b37 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:07.160448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-37c5ceb7-3303-4681-a1f4-1bfe69e90b37 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:07.161385 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-37c5ceb7-3303-4681-a1f4-1bfe69e90b37 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:07.161973 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-37c5ceb7-3303-4681-a1f4-1bfe69e90b37 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:07.219700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-86791536-4fa7-474c-b5ea-1d174855f119 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:07.229738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-86791536-4fa7-474c-b5ea-1d174855f119 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:07.231242 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-86791536-4fa7-474c-b5ea-1d174855f119 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:07.232937 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-86791536-4fa7-474c-b5ea-1d174855f119 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.222266 Jun 16 19:48:07.233723 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 342/708] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:48:07 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:48:07.339077 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a7453464-3dbd-4153-8371-55fda30dbb7f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:07.339694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a7453464-3dbd-4153-8371-55fda30dbb7f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:07.346020 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a7453464-3dbd-4153-8371-55fda30dbb7f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:07.346478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a7453464-3dbd-4153-8371-55fda30dbb7f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:07.347280 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a7453464-3dbd-4153-8371-55fda30dbb7f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:07.347723 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a7453464-3dbd-4153-8371-55fda30dbb7f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:07.364995 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-37c5ceb7-3303-4681-a1f4-1bfe69e90b37 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:07.374175 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-37c5ceb7-3303-4681-a1f4-1bfe69e90b37 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.227885 Jun 16 19:48:07.374747 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 367/709] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:07 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:07.422689 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-cdee1975-c978-4fac-baa0-5a4cb73a730a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:07.423340 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-cdee1975-c978-4fac-baa0-5a4cb73a730a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:07.430181 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cdee1975-c978-4fac-baa0-5a4cb73a730a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:07.430885 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cdee1975-c978-4fac-baa0-5a4cb73a730a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:07.431687 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cdee1975-c978-4fac-baa0-5a4cb73a730a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:07.432130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cdee1975-c978-4fac-baa0-5a4cb73a730a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:07.489239 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a7453464-3dbd-4153-8371-55fda30dbb7f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:07.497357 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a7453464-3dbd-4153-8371-55fda30dbb7f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.162385 Jun 16 19:48:07.497961 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 343/710] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:07 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:07.574019 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-cdee1975-c978-4fac-baa0-5a4cb73a730a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:07.581532 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-cdee1975-c978-4fac-baa0-5a4cb73a730a tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.163138 Jun 16 19:48:07.582095 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 368/711] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:07 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:08.153211 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c431b64e-471b-414f-9daf-164fe12245a3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:08.154176 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c431b64e-471b-414f-9daf-164fe12245a3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:08.160138 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c431b64e-471b-414f-9daf-164fe12245a3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:08.160623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c431b64e-471b-414f-9daf-164fe12245a3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:08.161448 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c431b64e-471b-414f-9daf-164fe12245a3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:08.161893 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c431b64e-471b-414f-9daf-164fe12245a3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:08.192767 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c431b64e-471b-414f-9daf-164fe12245a3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044162 Jun 16 19:48:08.193792 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 344/712] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:08 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:08.251412 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1459835d-cecd-4163-b59d-e9f2b8528d24 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:08.252025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-1459835d-cecd-4163-b59d-e9f2b8528d24 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:08.259221 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1459835d-cecd-4163-b59d-e9f2b8528d24 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:08.259664 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1459835d-cecd-4163-b59d-e9f2b8528d24 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:08.260419 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1459835d-cecd-4163-b59d-e9f2b8528d24 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:08.260848 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1459835d-cecd-4163-b59d-e9f2b8528d24 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:08.394393 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6a0f4ad7-6ca8-4544-9001-fb89f9701d84 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:08.394393 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6a0f4ad7-6ca8-4544-9001-fb89f9701d84 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:08.395380 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1459835d-cecd-4163-b59d-e9f2b8528d24 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:08.402343 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6a0f4ad7-6ca8-4544-9001-fb89f9701d84 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:08.411109 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6a0f4ad7-6ca8-4544-9001-fb89f9701d84 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:08.411109 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6a0f4ad7-6ca8-4544-9001-fb89f9701d84 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:08.411109 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6a0f4ad7-6ca8-4544-9001-fb89f9701d84 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:08.411413 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1459835d-cecd-4163-b59d-e9f2b8528d24 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:08.411413 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1459835d-cecd-4163-b59d-e9f2b8528d24 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:08.411413 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-1459835d-cecd-4163-b59d-e9f2b8528d24 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.161324 Jun 16 19:48:08.411671 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 369/713] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:48:08 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:48:08.514298 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-4a071a55-30e0-444d-b574-d4200e358847 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:08.515243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-4a071a55-30e0-444d-b574-d4200e358847 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:08.523456 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4a071a55-30e0-444d-b574-d4200e358847 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:08.524284 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4a071a55-30e0-444d-b574-d4200e358847 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:08.525525 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4a071a55-30e0-444d-b574-d4200e358847 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:08.526302 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4a071a55-30e0-444d-b574-d4200e358847 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:08.605470 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6a0f4ad7-6ca8-4544-9001-fb89f9701d84 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:08.613816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6a0f4ad7-6ca8-4544-9001-fb89f9701d84 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.225860 Jun 16 19:48:08.614385 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 345/714] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:08 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:08.619398 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-464bf7c2-a80f-453f-967d-5e7698b4d166 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:08.620865 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-464bf7c2-a80f-453f-967d-5e7698b4d166 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:08.625703 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-464bf7c2-a80f-453f-967d-5e7698b4d166 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:08.626329 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-464bf7c2-a80f-453f-967d-5e7698b4d166 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:08.627349 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-464bf7c2-a80f-453f-967d-5e7698b4d166 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:08.627781 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-464bf7c2-a80f-453f-967d-5e7698b4d166 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:08.660503 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-4a071a55-30e0-444d-b574-d4200e358847 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:08.668959 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-4a071a55-30e0-444d-b574-d4200e358847 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.158633 Jun 16 19:48:08.669604 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 370/715] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:08 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:08.763454 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-464bf7c2-a80f-453f-967d-5e7698b4d166 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:08.771011 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-464bf7c2-a80f-453f-967d-5e7698b4d166 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.155623 Jun 16 19:48:08.771587 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 346/716] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:08 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:09.208398 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c1414000-da88-49c9-ac2b-405b40678bd5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:09.209386 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c1414000-da88-49c9-ac2b-405b40678bd5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:09.216834 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c1414000-da88-49c9-ac2b-405b40678bd5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:09.217207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c1414000-da88-49c9-ac2b-405b40678bd5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:09.218773 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c1414000-da88-49c9-ac2b-405b40678bd5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:09.219250 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c1414000-da88-49c9-ac2b-405b40678bd5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:09.249862 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c1414000-da88-49c9-ac2b-405b40678bd5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045495 Jun 16 19:48:09.250424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 371/717] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:09 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:09.433984 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-74bd5084-25ad-45b0-82e4-b49b83edbc83 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:09.434677 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-74bd5084-25ad-45b0-82e4-b49b83edbc83 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:09.441756 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74bd5084-25ad-45b0-82e4-b49b83edbc83 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:09.442208 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74bd5084-25ad-45b0-82e4-b49b83edbc83 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:09.443085 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74bd5084-25ad-45b0-82e4-b49b83edbc83 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:09.443774 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74bd5084-25ad-45b0-82e4-b49b83edbc83 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:09.569611 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-74bd5084-25ad-45b0-82e4-b49b83edbc83 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:09.583129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-74bd5084-25ad-45b0-82e4-b49b83edbc83 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:09.583129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-74bd5084-25ad-45b0-82e4-b49b83edbc83 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:09.583129 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-74bd5084-25ad-45b0-82e4-b49b83edbc83 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.151986 Jun 16 19:48:09.583772 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 347/718] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:48:09 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:48:09.635826 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-de330e86-8d94-4d69-87ce-7230192d1b7c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:09.648825 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-de330e86-8d94-4d69-87ce-7230192d1b7c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:09.648825 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-de330e86-8d94-4d69-87ce-7230192d1b7c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:09.648825 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-de330e86-8d94-4d69-87ce-7230192d1b7c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:09.648825 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-de330e86-8d94-4d69-87ce-7230192d1b7c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:09.649239 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-de330e86-8d94-4d69-87ce-7230192d1b7c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:09.686126 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-47e3bdb7-8efd-46f0-9103-99d53f4c10ff tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:09.686790 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-47e3bdb7-8efd-46f0-9103-99d53f4c10ff tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:09.692871 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-47e3bdb7-8efd-46f0-9103-99d53f4c10ff tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:09.693646 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-47e3bdb7-8efd-46f0-9103-99d53f4c10ff tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:09.694478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-47e3bdb7-8efd-46f0-9103-99d53f4c10ff tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:09.695139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-47e3bdb7-8efd-46f0-9103-99d53f4c10ff tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:09.776326 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-de330e86-8d94-4d69-87ce-7230192d1b7c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:09.784712 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-de330e86-8d94-4d69-87ce-7230192d1b7c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.153207 Jun 16 19:48:09.785289 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 372/719] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:09 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:09.790500 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-86b65212-3fed-45b4-a94c-7553ca79ef6f tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:09.791130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-86b65212-3fed-45b4-a94c-7553ca79ef6f tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:09.797384 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-86b65212-3fed-45b4-a94c-7553ca79ef6f tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:09.797832 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-86b65212-3fed-45b4-a94c-7553ca79ef6f tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:09.798594 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-86b65212-3fed-45b4-a94c-7553ca79ef6f tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:09.799058 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-86b65212-3fed-45b4-a94c-7553ca79ef6f tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:09.848883 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-47e3bdb7-8efd-46f0-9103-99d53f4c10ff tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:09.856935 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-47e3bdb7-8efd-46f0-9103-99d53f4c10ff tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.174730 Jun 16 19:48:09.857650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 348/720] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:09 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:09.928285 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-86b65212-3fed-45b4-a94c-7553ca79ef6f tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:09.935608 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-86b65212-3fed-45b4-a94c-7553ca79ef6f tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.149156 Jun 16 19:48:09.936244 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 373/721] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:09 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:10.262205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-18baac64-78d3-4172-9119-5f9f36cb2ef2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:10.266116 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-18baac64-78d3-4172-9119-5f9f36cb2ef2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:10.269273 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-18baac64-78d3-4172-9119-5f9f36cb2ef2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:10.269722 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-18baac64-78d3-4172-9119-5f9f36cb2ef2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:10.270483 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-18baac64-78d3-4172-9119-5f9f36cb2ef2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:10.270915 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-18baac64-78d3-4172-9119-5f9f36cb2ef2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:10.299211 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-18baac64-78d3-4172-9119-5f9f36cb2ef2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041420 Jun 16 19:48:10.299775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 349/722] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:10 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:48:10.501655 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e4269013-750b-45cb-9150-d1454fc5ee2d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1819021918"}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:48:10.502203 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e4269013-750b-45cb-9150-d1454fc5ee2d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:10.508827 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e4269013-750b-45cb-9150-d1454fc5ee2d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:10.509280 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e4269013-750b-45cb-9150-d1454fc5ee2d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:10.510040 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e4269013-750b-45cb-9150-d1454fc5ee2d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:10.510481 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e4269013-750b-45cb-9150-d1454fc5ee2d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:10.599382 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3c25ec6d-0150-4931-b94f-3f51a0c2cc9d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:10.602329 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3c25ec6d-0150-4931-b94f-3f51a0c2cc9d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:10.607143 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3c25ec6d-0150-4931-b94f-3f51a0c2cc9d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:10.607590 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3c25ec6d-0150-4931-b94f-3f51a0c2cc9d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:10.608349 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3c25ec6d-0150-4931-b94f-3f51a0c2cc9d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:10.608775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3c25ec6d-0150-4931-b94f-3f51a0c2cc9d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:10.640105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.network.security_group_api [None req-e4269013-750b-45cb-9150-d1454fc5ee2d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Adding security group d9cf1295-81d8-4630-92bf-3d0ed9b29b14 to port 8b0eb30b-d9a5-4b32-a7b4-cff5a9a46047 Jun 16 19:48:10.737680 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3c25ec6d-0150-4931-b94f-3f51a0c2cc9d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:10.747245 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3c25ec6d-0150-4931-b94f-3f51a0c2cc9d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:10.748715 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3c25ec6d-0150-4931-b94f-3f51a0c2cc9d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:10.749911 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3c25ec6d-0150-4931-b94f-3f51a0c2cc9d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.154377 Jun 16 19:48:10.750467 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 350/723] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:48:10 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:48:10.801467 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9d29a6bc-6834-41df-b6b6-b095bef20dd6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:10.802075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9d29a6bc-6834-41df-b6b6-b095bef20dd6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:10.808757 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d29a6bc-6834-41df-b6b6-b095bef20dd6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:10.809202 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d29a6bc-6834-41df-b6b6-b095bef20dd6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:10.809964 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d29a6bc-6834-41df-b6b6-b095bef20dd6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:10.810396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d29a6bc-6834-41df-b6b6-b095bef20dd6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:10.938023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9d29a6bc-6834-41df-b6b6-b095bef20dd6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:10.946328 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9d29a6bc-6834-41df-b6b6-b095bef20dd6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.148694 Jun 16 19:48:10.947495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 351/724] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:10 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:10.951325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d535c0f7-c847-4559-83da-5c7497d59d74 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:10.951929 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d535c0f7-c847-4559-83da-5c7497d59d74 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:10.957389 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d535c0f7-c847-4559-83da-5c7497d59d74 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:10.957836 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d535c0f7-c847-4559-83da-5c7497d59d74 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:10.958594 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d535c0f7-c847-4559-83da-5c7497d59d74 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:10.959061 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d535c0f7-c847-4559-83da-5c7497d59d74 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:11.089921 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e4269013-750b-45cb-9150-d1454fc5ee2d tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "POST /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/action" status: 202 len: 0 microversion: 2.1 time: 0.592125 Jun 16 19:48:11.090714 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 374/725] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Jun 16 19:48:10 2022] POST /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:48:11.095844 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d535c0f7-c847-4559-83da-5c7497d59d74 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:11.102728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-164c9f7a-2e33-41a4-8268-c8f671a226ab tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:11.104463 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-164c9f7a-2e33-41a4-8268-c8f671a226ab tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:11.113976 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d535c0f7-c847-4559-83da-5c7497d59d74 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.165789 Jun 16 19:48:11.115071 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 352/726] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:10 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:11.120750 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5362a06a-e4c4-4d55-996c-a939a9f34536 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:11.121355 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5362a06a-e4c4-4d55-996c-a939a9f34536 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:11.125661 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-164c9f7a-2e33-41a4-8268-c8f671a226ab tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:11.126345 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-164c9f7a-2e33-41a4-8268-c8f671a226ab tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:11.128358 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-164c9f7a-2e33-41a4-8268-c8f671a226ab tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:11.129434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-164c9f7a-2e33-41a4-8268-c8f671a226ab tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:11.131349 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5362a06a-e4c4-4d55-996c-a939a9f34536 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:11.131805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5362a06a-e4c4-4d55-996c-a939a9f34536 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:11.132614 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5362a06a-e4c4-4d55-996c-a939a9f34536 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:11.133044 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5362a06a-e4c4-4d55-996c-a939a9f34536 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:11.158443 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:11.317988 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-164c9f7a-2e33-41a4-8268-c8f671a226ab tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:11.325866 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-164c9f7a-2e33-41a4-8268-c8f671a226ab tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.227914 Jun 16 19:48:11.326684 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 375/727] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:11 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:11.329267 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5362a06a-e4c4-4d55-996c-a939a9f34536 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:11.331845 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-93f38a58-7637-4b1a-914b-d4cd0c7da696 req-cec3fff1-b08f-443c-a74d-45a222f23017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf542d63-f9a6-4101-a1a0-be5fff525e1e", "tag": "8b0eb30b-d9a5-4b32-a7b4-cff5a9a46047"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:48:11.338076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5362a06a-e4c4-4d55-996c-a939a9f34536 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1639 microversion: 2.1 time: 0.222499 Jun 16 19:48:11.352171 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 353/728] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:11 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1639 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:11.352425 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-93f38a58-7637-4b1a-914b-d4cd0c7da696 req-cec3fff1-b08f-443c-a74d-45a222f23017 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:11.352425 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-93f38a58-7637-4b1a-914b-d4cd0c7da696 req-cec3fff1-b08f-443c-a74d-45a222f23017 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:11.352604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5279c3c9-cabe-423b-a677-a42399d295c5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:11.352604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5279c3c9-cabe-423b-a677-a42399d295c5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:11.355011 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-93f38a58-7637-4b1a-914b-d4cd0c7da696 req-cec3fff1-b08f-443c-a74d-45a222f23017 service nova] Creating event network-changed:8b0eb30b-d9a5-4b32-a7b4-cff5a9a46047 for instance bf542d63-f9a6-4101-a1a0-be5fff525e1e on hv-cinder-84617 Jun 16 19:48:11.360030 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-93f38a58-7637-4b1a-914b-d4cd0c7da696 req-cec3fff1-b08f-443c-a74d-45a222f23017 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031956 Jun 16 19:48:11.360446 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5279c3c9-cabe-423b-a677-a42399d295c5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:11.360934 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5279c3c9-cabe-423b-a677-a42399d295c5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:11.361707 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5279c3c9-cabe-423b-a677-a42399d295c5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:11.362218 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5279c3c9-cabe-423b-a677-a42399d295c5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:11.363732 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 376/729] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:11.391748 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5279c3c9-cabe-423b-a677-a42399d295c5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050845 Jun 16 19:48:11.392225 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 354/730] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:11 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:11.769837 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a2edcd7a-5192-48a1-b0b6-bed130e7bc84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:11.770679 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a2edcd7a-5192-48a1-b0b6-bed130e7bc84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:11.776927 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a2edcd7a-5192-48a1-b0b6-bed130e7bc84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:11.777426 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a2edcd7a-5192-48a1-b0b6-bed130e7bc84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:11.778183 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a2edcd7a-5192-48a1-b0b6-bed130e7bc84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:11.778615 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a2edcd7a-5192-48a1-b0b6-bed130e7bc84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:11.912440 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a2edcd7a-5192-48a1-b0b6-bed130e7bc84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:11.920857 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a2edcd7a-5192-48a1-b0b6-bed130e7bc84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:11.922359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a2edcd7a-5192-48a1-b0b6-bed130e7bc84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:11.923590 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a2edcd7a-5192-48a1-b0b6-bed130e7bc84 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.158654 Jun 16 19:48:11.927045 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 377/731] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:48:11 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:48:11.962666 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f845dab3-1d58-4c7b-95d1-ed38029f33c7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:11.963280 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f845dab3-1d58-4c7b-95d1-ed38029f33c7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:11.969223 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f845dab3-1d58-4c7b-95d1-ed38029f33c7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:11.969671 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f845dab3-1d58-4c7b-95d1-ed38029f33c7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:11.970430 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f845dab3-1d58-4c7b-95d1-ed38029f33c7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:11.970866 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f845dab3-1d58-4c7b-95d1-ed38029f33c7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:12.098805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f845dab3-1d58-4c7b-95d1-ed38029f33c7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:12.107255 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f845dab3-1d58-4c7b-95d1-ed38029f33c7 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.148331 Jun 16 19:48:12.108937 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 355/732] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:11 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:12.130417 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f588d923-3451-4a72-81a3-97fd26b8bc51 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:12.131051 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f588d923-3451-4a72-81a3-97fd26b8bc51 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:12.136994 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f588d923-3451-4a72-81a3-97fd26b8bc51 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:12.137442 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f588d923-3451-4a72-81a3-97fd26b8bc51 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:12.138195 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f588d923-3451-4a72-81a3-97fd26b8bc51 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:12.138627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f588d923-3451-4a72-81a3-97fd26b8bc51 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:12.264443 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f588d923-3451-4a72-81a3-97fd26b8bc51 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:12.271885 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f588d923-3451-4a72-81a3-97fd26b8bc51 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.145210 Jun 16 19:48:12.272451 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 378/733] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:12 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:12.343189 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3a849ea6-7c60-46c6-ad08-7e19a72341e1 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:12.343792 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3a849ea6-7c60-46c6-ad08-7e19a72341e1 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:12.349710 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a849ea6-7c60-46c6-ad08-7e19a72341e1 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:12.350147 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a849ea6-7c60-46c6-ad08-7e19a72341e1 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:12.350889 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a849ea6-7c60-46c6-ad08-7e19a72341e1 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:12.351336 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a849ea6-7c60-46c6-ad08-7e19a72341e1 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:12.403955 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f505ee6e-003a-40c6-af41-2d72b13426eb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:12.404933 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f505ee6e-003a-40c6-af41-2d72b13426eb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:12.411094 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f505ee6e-003a-40c6-af41-2d72b13426eb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:12.411541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f505ee6e-003a-40c6-af41-2d72b13426eb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:12.412296 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f505ee6e-003a-40c6-af41-2d72b13426eb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:12.412724 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f505ee6e-003a-40c6-af41-2d72b13426eb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:12.441329 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f505ee6e-003a-40c6-af41-2d72b13426eb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041485 Jun 16 19:48:12.441871 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 379/734] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:12 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:48:12.477666 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3a849ea6-7c60-46c6-ad08-7e19a72341e1 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:12.485057 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3a849ea6-7c60-46c6-ad08-7e19a72341e1 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.145869 Jun 16 19:48:12.485618 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 356/735] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:12 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:12.942394 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-99827f7c-1d01-4e9a-af5d-916476ca7a52 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:12.943031 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-99827f7c-1d01-4e9a-af5d-916476ca7a52 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:12.949748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-99827f7c-1d01-4e9a-af5d-916476ca7a52 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:12.950200 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-99827f7c-1d01-4e9a-af5d-916476ca7a52 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:12.950986 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-99827f7c-1d01-4e9a-af5d-916476ca7a52 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:12.951426 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-99827f7c-1d01-4e9a-af5d-916476ca7a52 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:13.089784 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-99827f7c-1d01-4e9a-af5d-916476ca7a52 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:13.098188 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-99827f7c-1d01-4e9a-af5d-916476ca7a52 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:13.099731 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-99827f7c-1d01-4e9a-af5d-916476ca7a52 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:13.100884 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-99827f7c-1d01-4e9a-af5d-916476ca7a52 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.162400 Jun 16 19:48:13.101931 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 380/736] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:48:12 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:48:13.123999 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-52bb199d-a319-4823-8db1-6b49f12d746e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:13.124606 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-52bb199d-a319-4823-8db1-6b49f12d746e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:13.130562 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-52bb199d-a319-4823-8db1-6b49f12d746e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:13.131043 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-52bb199d-a319-4823-8db1-6b49f12d746e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:13.131801 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-52bb199d-a319-4823-8db1-6b49f12d746e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:13.132239 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-52bb199d-a319-4823-8db1-6b49f12d746e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:13.149958 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:13.272583 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-52bb199d-a319-4823-8db1-6b49f12d746e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:13.280508 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-52bb199d-a319-4823-8db1-6b49f12d746e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.160266 Jun 16 19:48:13.281064 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 357/737] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:13 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:13.288217 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-39c0b9be-8196-4e42-8d42-6d73a6e66083 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:13.288914 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-39c0b9be-8196-4e42-8d42-6d73a6e66083 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:13.294874 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-39c0b9be-8196-4e42-8d42-6d73a6e66083 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:13.295346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-39c0b9be-8196-4e42-8d42-6d73a6e66083 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:13.296096 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-39c0b9be-8196-4e42-8d42-6d73a6e66083 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:13.296528 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-39c0b9be-8196-4e42-8d42-6d73a6e66083 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:13.424013 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-39c0b9be-8196-4e42-8d42-6d73a6e66083 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:13.432305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-39c0b9be-8196-4e42-8d42-6d73a6e66083 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.147751 Jun 16 19:48:13.432887 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 381/738] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:13 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:13.457927 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3bb50ceb-06fc-4410-8531-37d5fba29417 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:13.458992 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3bb50ceb-06fc-4410-8531-37d5fba29417 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:13.464830 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3bb50ceb-06fc-4410-8531-37d5fba29417 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:13.465274 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3bb50ceb-06fc-4410-8531-37d5fba29417 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:13.466028 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3bb50ceb-06fc-4410-8531-37d5fba29417 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:13.466462 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3bb50ceb-06fc-4410-8531-37d5fba29417 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:13.495033 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3bb50ceb-06fc-4410-8531-37d5fba29417 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041001 Jun 16 19:48:13.495592 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 358/739] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:13 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:13.502481 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-315ab214-3675-4c93-9aab-c458896cb17e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:13.503123 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-315ab214-3675-4c93-9aab-c458896cb17e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:13.509577 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-315ab214-3675-4c93-9aab-c458896cb17e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:13.510020 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-315ab214-3675-4c93-9aab-c458896cb17e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:13.510772 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-315ab214-3675-4c93-9aab-c458896cb17e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:13.511233 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-315ab214-3675-4c93-9aab-c458896cb17e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:13.787985 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-315ab214-3675-4c93-9aab-c458896cb17e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:13.795795 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-315ab214-3675-4c93-9aab-c458896cb17e tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.297053 Jun 16 19:48:13.796348 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 382/740] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:13 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:14.119748 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-23cb37ce-e678-4767-8f8d-3187af9a8f6d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:14.120380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-23cb37ce-e678-4767-8f8d-3187af9a8f6d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:14.126287 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-23cb37ce-e678-4767-8f8d-3187af9a8f6d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:14.126950 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-23cb37ce-e678-4767-8f8d-3187af9a8f6d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:14.127501 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-23cb37ce-e678-4767-8f8d-3187af9a8f6d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:14.127935 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-23cb37ce-e678-4767-8f8d-3187af9a8f6d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:14.253022 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-23cb37ce-e678-4767-8f8d-3187af9a8f6d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:14.261307 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-23cb37ce-e678-4767-8f8d-3187af9a8f6d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:14.262796 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-23cb37ce-e678-4767-8f8d-3187af9a8f6d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:14.263965 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-23cb37ce-e678-4767-8f8d-3187af9a8f6d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.148186 Jun 16 19:48:14.264520 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 359/741] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:48:14 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:48:14.297214 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-92b189e8-d637-4758-9cd3-7696fad0fc35 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:14.297826 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-92b189e8-d637-4758-9cd3-7696fad0fc35 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:14.304331 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-92b189e8-d637-4758-9cd3-7696fad0fc35 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:14.304777 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-92b189e8-d637-4758-9cd3-7696fad0fc35 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:14.305531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-92b189e8-d637-4758-9cd3-7696fad0fc35 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:14.305963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-92b189e8-d637-4758-9cd3-7696fad0fc35 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:14.433481 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-92b189e8-d637-4758-9cd3-7696fad0fc35 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:14.441422 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-92b189e8-d637-4758-9cd3-7696fad0fc35 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.148031 Jun 16 19:48:14.442053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 383/742] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:14 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:14.449078 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f857d5f0-538c-4f82-a44b-2c6a1349a474 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:14.449689 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f857d5f0-538c-4f82-a44b-2c6a1349a474 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:14.455643 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f857d5f0-538c-4f82-a44b-2c6a1349a474 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:14.456086 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f857d5f0-538c-4f82-a44b-2c6a1349a474 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:14.456841 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f857d5f0-538c-4f82-a44b-2c6a1349a474 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:14.457267 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f857d5f0-538c-4f82-a44b-2c6a1349a474 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:14.505873 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-59804295-a2a7-436f-8656-f11949401a55 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:14.507007 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-59804295-a2a7-436f-8656-f11949401a55 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:14.513506 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-59804295-a2a7-436f-8656-f11949401a55 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:14.513957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-59804295-a2a7-436f-8656-f11949401a55 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:14.514720 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-59804295-a2a7-436f-8656-f11949401a55 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:14.515184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-59804295-a2a7-436f-8656-f11949401a55 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:14.544634 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-59804295-a2a7-436f-8656-f11949401a55 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042713 Jun 16 19:48:14.545388 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 384/743] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:14 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:48:14.582339 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f857d5f0-538c-4f82-a44b-2c6a1349a474 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:14.590187 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f857d5f0-538c-4f82-a44b-2c6a1349a474 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.145396 Jun 16 19:48:14.590740 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 360/744] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:14 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:14.812940 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e191f3f8-30be-43ba-8823-c7ccbd99321d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:14.813549 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e191f3f8-30be-43ba-8823-c7ccbd99321d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:14.820387 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e191f3f8-30be-43ba-8823-c7ccbd99321d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:14.820842 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e191f3f8-30be-43ba-8823-c7ccbd99321d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:14.821603 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e191f3f8-30be-43ba-8823-c7ccbd99321d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:14.822037 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e191f3f8-30be-43ba-8823-c7ccbd99321d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:14.949386 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e191f3f8-30be-43ba-8823-c7ccbd99321d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:14.956985 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e191f3f8-30be-43ba-8823-c7ccbd99321d tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.147866 Jun 16 19:48:14.957540 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 385/745] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:14 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:15.281702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5758cb6b-619d-4116-bd7a-5374ddb40fe0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:15.282307 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5758cb6b-619d-4116-bd7a-5374ddb40fe0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:15.289002 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5758cb6b-619d-4116-bd7a-5374ddb40fe0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:15.289447 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5758cb6b-619d-4116-bd7a-5374ddb40fe0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:15.290202 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5758cb6b-619d-4116-bd7a-5374ddb40fe0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:15.290633 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5758cb6b-619d-4116-bd7a-5374ddb40fe0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:15.419651 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5758cb6b-619d-4116-bd7a-5374ddb40fe0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:15.427845 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5758cb6b-619d-4116-bd7a-5374ddb40fe0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:15.429866 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5758cb6b-619d-4116-bd7a-5374ddb40fe0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:15.431048 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5758cb6b-619d-4116-bd7a-5374ddb40fe0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.153175 Jun 16 19:48:15.431603 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 361/746] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:48:15 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:48:15.458994 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-11da48ab-0c6a-473b-a6b3-861473601075 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:15.459623 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-11da48ab-0c6a-473b-a6b3-861473601075 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:15.466889 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-11da48ab-0c6a-473b-a6b3-861473601075 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:15.467380 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-11da48ab-0c6a-473b-a6b3-861473601075 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:15.468141 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-11da48ab-0c6a-473b-a6b3-861473601075 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:15.468624 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-11da48ab-0c6a-473b-a6b3-861473601075 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:15.556231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f02b0cc4-0b9b-467e-82da-3997f4c446f3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:15.557213 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f02b0cc4-0b9b-467e-82da-3997f4c446f3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:15.563231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f02b0cc4-0b9b-467e-82da-3997f4c446f3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:15.563680 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f02b0cc4-0b9b-467e-82da-3997f4c446f3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:15.564445 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f02b0cc4-0b9b-467e-82da-3997f4c446f3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:15.564875 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f02b0cc4-0b9b-467e-82da-3997f4c446f3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:15.594284 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-11da48ab-0c6a-473b-a6b3-861473601075 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:15.595059 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f02b0cc4-0b9b-467e-82da-3997f4c446f3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042713 Jun 16 19:48:15.595624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 362/747] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:15 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:48:15.602876 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-11da48ab-0c6a-473b-a6b3-861473601075 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.147691 Jun 16 19:48:15.603641 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 386/748] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:15 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:15.607601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-af9d4b96-c645-4c7b-8ab1-2bcbe3f5f25f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:15.608217 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-af9d4b96-c645-4c7b-8ab1-2bcbe3f5f25f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:15.614130 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-af9d4b96-c645-4c7b-8ab1-2bcbe3f5f25f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:15.614496 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-af9d4b96-c645-4c7b-8ab1-2bcbe3f5f25f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:15.615284 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-af9d4b96-c645-4c7b-8ab1-2bcbe3f5f25f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:15.615769 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-af9d4b96-c645-4c7b-8ab1-2bcbe3f5f25f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:15.740755 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-af9d4b96-c645-4c7b-8ab1-2bcbe3f5f25f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:15.748126 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-af9d4b96-c645-4c7b-8ab1-2bcbe3f5f25f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.144502 Jun 16 19:48:15.748714 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 363/749] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:15 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:15.973604 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-75fdb855-6b4e-4c08-a215-99e1f88c82e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:15.974224 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-75fdb855-6b4e-4c08-a215-99e1f88c82e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:15.980207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-75fdb855-6b4e-4c08-a215-99e1f88c82e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:15.980655 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-75fdb855-6b4e-4c08-a215-99e1f88c82e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:15.981435 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-75fdb855-6b4e-4c08-a215-99e1f88c82e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:15.981866 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-75fdb855-6b4e-4c08-a215-99e1f88c82e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:16.108269 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-75fdb855-6b4e-4c08-a215-99e1f88c82e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:16.115856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-75fdb855-6b4e-4c08-a215-99e1f88c82e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.146192 Jun 16 19:48:16.116550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 387/750] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:15 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:16.449942 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cf111b5a-23df-430c-a2bf-2273e764caee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:16.450548 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-cf111b5a-23df-430c-a2bf-2273e764caee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:16.456482 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cf111b5a-23df-430c-a2bf-2273e764caee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:16.456952 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cf111b5a-23df-430c-a2bf-2273e764caee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:16.457701 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cf111b5a-23df-430c-a2bf-2273e764caee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:16.458139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cf111b5a-23df-430c-a2bf-2273e764caee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:16.585005 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cf111b5a-23df-430c-a2bf-2273e764caee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:16.593214 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cf111b5a-23df-430c-a2bf-2273e764caee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:16.594686 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cf111b5a-23df-430c-a2bf-2273e764caee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:16.595854 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cf111b5a-23df-430c-a2bf-2273e764caee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.149774 Jun 16 19:48:16.596402 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 364/751] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:48:16 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:48:16.606526 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-abeb5b55-cfa4-45ae-92a2-dff98c4f9ee9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:16.607469 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-abeb5b55-cfa4-45ae-92a2-dff98c4f9ee9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:16.609949 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:16.614574 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-abeb5b55-cfa4-45ae-92a2-dff98c4f9ee9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:16.615041 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-abeb5b55-cfa4-45ae-92a2-dff98c4f9ee9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:16.615787 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-abeb5b55-cfa4-45ae-92a2-dff98c4f9ee9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:16.616217 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-abeb5b55-cfa4-45ae-92a2-dff98c4f9ee9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:16.623558 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2d74d4f1-9de0-42bb-b436-9e0d549f0711 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:16.624159 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2d74d4f1-9de0-42bb-b436-9e0d549f0711 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:16.630034 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2d74d4f1-9de0-42bb-b436-9e0d549f0711 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:16.630391 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2d74d4f1-9de0-42bb-b436-9e0d549f0711 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:16.631224 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2d74d4f1-9de0-42bb-b436-9e0d549f0711 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:16.631657 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2d74d4f1-9de0-42bb-b436-9e0d549f0711 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:16.647399 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-abeb5b55-cfa4-45ae-92a2-dff98c4f9ee9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Jun 16 19:48:16.647950 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 388/752] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:16 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:16.756164 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2d74d4f1-9de0-42bb-b436-9e0d549f0711 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:16.764016 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2d74d4f1-9de0-42bb-b436-9e0d549f0711 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.144089 Jun 16 19:48:16.764201 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7e6203de-88b0-4771-9510-888c85755c4f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:16.764572 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 365/753] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:16 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:16.764761 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-7e6203de-88b0-4771-9510-888c85755c4f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:16.770666 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7e6203de-88b0-4771-9510-888c85755c4f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:16.771149 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7e6203de-88b0-4771-9510-888c85755c4f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:16.771914 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7e6203de-88b0-4771-9510-888c85755c4f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:16.772345 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7e6203de-88b0-4771-9510-888c85755c4f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:16.897601 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-7e6203de-88b0-4771-9510-888c85755c4f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:16.904999 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-7e6203de-88b0-4771-9510-888c85755c4f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.144610 Jun 16 19:48:16.905554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 389/754] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:16 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:17.131690 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-25e065b7-3cf1-48ca-bff4-d2c2bdb7af59 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:17.132860 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-25e065b7-3cf1-48ca-bff4-d2c2bdb7af59 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:17.138842 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-25e065b7-3cf1-48ca-bff4-d2c2bdb7af59 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:17.139312 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-25e065b7-3cf1-48ca-bff4-d2c2bdb7af59 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:17.140053 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-25e065b7-3cf1-48ca-bff4-d2c2bdb7af59 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:17.140479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-25e065b7-3cf1-48ca-bff4-d2c2bdb7af59 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:17.264256 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-25e065b7-3cf1-48ca-bff4-d2c2bdb7af59 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:17.271947 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-25e065b7-3cf1-48ca-bff4-d2c2bdb7af59 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.144092 Jun 16 19:48:17.272494 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 366/755] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:17 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:17.613572 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6d2a1919-6e38-4625-b146-c025132a84fd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:17.614172 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6d2a1919-6e38-4625-b146-c025132a84fd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:17.620655 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6d2a1919-6e38-4625-b146-c025132a84fd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:17.621104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6d2a1919-6e38-4625-b146-c025132a84fd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:17.621901 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6d2a1919-6e38-4625-b146-c025132a84fd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:17.622338 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6d2a1919-6e38-4625-b146-c025132a84fd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:17.658783 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3a85dc0f-288b-47a6-bdfc-db423007a1e2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:17.659809 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3a85dc0f-288b-47a6-bdfc-db423007a1e2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:17.665817 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a85dc0f-288b-47a6-bdfc-db423007a1e2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:17.666260 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a85dc0f-288b-47a6-bdfc-db423007a1e2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:17.667048 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a85dc0f-288b-47a6-bdfc-db423007a1e2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:17.667482 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a85dc0f-288b-47a6-bdfc-db423007a1e2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:17.697182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3a85dc0f-288b-47a6-bdfc-db423007a1e2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042121 Jun 16 19:48:17.697752 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 367/756] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:17 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:48:17.756723 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6d2a1919-6e38-4625-b146-c025132a84fd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:17.765925 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6d2a1919-6e38-4625-b146-c025132a84fd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:17.843259 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6d2a1919-6e38-4625-b146-c025132a84fd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:17.843259 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6d2a1919-6e38-4625-b146-c025132a84fd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.158930 Jun 16 19:48:17.843259 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 390/757] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:48:17 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:48:17.844036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7f0b076a-72f8-49a8-a734-62caa32dbd2b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:17.844036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7f0b076a-72f8-49a8-a734-62caa32dbd2b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:17.844036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7f0b076a-72f8-49a8-a734-62caa32dbd2b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:17.844036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7f0b076a-72f8-49a8-a734-62caa32dbd2b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:17.844352 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7f0b076a-72f8-49a8-a734-62caa32dbd2b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:17.844352 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7f0b076a-72f8-49a8-a734-62caa32dbd2b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:17.921925 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-607dde5e-21ff-43c4-aafd-ba7df4618e01 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:17.922576 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-607dde5e-21ff-43c4-aafd-ba7df4618e01 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:17.923641 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7f0b076a-72f8-49a8-a734-62caa32dbd2b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:17.928737 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-607dde5e-21ff-43c4-aafd-ba7df4618e01 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:17.929689 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-607dde5e-21ff-43c4-aafd-ba7df4618e01 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:17.930495 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-607dde5e-21ff-43c4-aafd-ba7df4618e01 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:17.930948 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-607dde5e-21ff-43c4-aafd-ba7df4618e01 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:17.931965 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7f0b076a-72f8-49a8-a734-62caa32dbd2b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.155153 Jun 16 19:48:17.932531 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 368/758] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:17 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:18.055451 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-607dde5e-21ff-43c4-aafd-ba7df4618e01 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:18.063589 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-607dde5e-21ff-43c4-aafd-ba7df4618e01 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.145746 Jun 16 19:48:18.064270 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 391/759] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:17 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:18.297520 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-05d4e83c-152c-4140-8dc0-bca1d18fef79 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:18.298117 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-05d4e83c-152c-4140-8dc0-bca1d18fef79 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:18.304157 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-05d4e83c-152c-4140-8dc0-bca1d18fef79 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:18.305140 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-05d4e83c-152c-4140-8dc0-bca1d18fef79 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:18.305879 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-05d4e83c-152c-4140-8dc0-bca1d18fef79 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:18.306303 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-05d4e83c-152c-4140-8dc0-bca1d18fef79 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:18.434643 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-05d4e83c-152c-4140-8dc0-bca1d18fef79 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:18.442015 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-05d4e83c-152c-4140-8dc0-bca1d18fef79 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.148332 Jun 16 19:48:18.442568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 369/760] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:18 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:18.709026 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-509659ac-c087-4875-9121-7ebb335727f4 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:18.709958 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-509659ac-c087-4875-9121-7ebb335727f4 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:18.716419 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-509659ac-c087-4875-9121-7ebb335727f4 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:18.716861 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-509659ac-c087-4875-9121-7ebb335727f4 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:18.717615 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-509659ac-c087-4875-9121-7ebb335727f4 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:18.718046 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-509659ac-c087-4875-9121-7ebb335727f4 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:18.742459 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:18.746804 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-509659ac-c087-4875-9121-7ebb335727f4 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042331 Jun 16 19:48:18.747373 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 392/761] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:18 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:18.859328 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8ae50d23-fbec-4576-af61-e8ec45a68a75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:18.859934 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8ae50d23-fbec-4576-af61-e8ec45a68a75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:18.865876 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8ae50d23-fbec-4576-af61-e8ec45a68a75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:18.866325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8ae50d23-fbec-4576-af61-e8ec45a68a75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:18.867687 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8ae50d23-fbec-4576-af61-e8ec45a68a75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:18.868124 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8ae50d23-fbec-4576-af61-e8ec45a68a75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:18.949270 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-19d263ce-f3fe-46c5-81ea-602d0b6405ee tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:18.949884 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-19d263ce-f3fe-46c5-81ea-602d0b6405ee tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:18.955870 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-19d263ce-f3fe-46c5-81ea-602d0b6405ee tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:18.956318 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-19d263ce-f3fe-46c5-81ea-602d0b6405ee tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:18.957077 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-19d263ce-f3fe-46c5-81ea-602d0b6405ee tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:18.957512 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-19d263ce-f3fe-46c5-81ea-602d0b6405ee tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:18.993654 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8ae50d23-fbec-4576-af61-e8ec45a68a75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:19.002061 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8ae50d23-fbec-4576-af61-e8ec45a68a75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:19.003584 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8ae50d23-fbec-4576-af61-e8ec45a68a75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:19.004744 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8ae50d23-fbec-4576-af61-e8ec45a68a75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.149285 Jun 16 19:48:19.005300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 370/762] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:48:18 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:48:19.082046 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-68662296-f736-4912-a1e1-7a7a6312bc4e tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:19.082646 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-68662296-f736-4912-a1e1-7a7a6312bc4e tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:19.085673 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-19d263ce-f3fe-46c5-81ea-602d0b6405ee tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:19.089418 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-68662296-f736-4912-a1e1-7a7a6312bc4e tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:19.089856 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-68662296-f736-4912-a1e1-7a7a6312bc4e tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:19.090768 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-68662296-f736-4912-a1e1-7a7a6312bc4e tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:19.091287 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-68662296-f736-4912-a1e1-7a7a6312bc4e tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:19.093955 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-19d263ce-f3fe-46c5-81ea-602d0b6405ee tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.148854 Jun 16 19:48:19.098368 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 393/763] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:18 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:19.226547 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-68662296-f736-4912-a1e1-7a7a6312bc4e tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:19.233922 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-68662296-f736-4912-a1e1-7a7a6312bc4e tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.155693 Jun 16 19:48:19.234477 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 371/764] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:19 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:19.459898 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-4d7472bc-051e-4a0d-b001-7e0f8f1936a2 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:19.461713 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-4d7472bc-051e-4a0d-b001-7e0f8f1936a2 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:19.471563 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4d7472bc-051e-4a0d-b001-7e0f8f1936a2 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:19.472011 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4d7472bc-051e-4a0d-b001-7e0f8f1936a2 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:19.472777 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4d7472bc-051e-4a0d-b001-7e0f8f1936a2 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:19.473273 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4d7472bc-051e-4a0d-b001-7e0f8f1936a2 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:19.635374 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-4d7472bc-051e-4a0d-b001-7e0f8f1936a2 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:19.643233 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-4d7472bc-051e-4a0d-b001-7e0f8f1936a2 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.187629 Jun 16 19:48:19.643995 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 394/765] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:19 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:19.767070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c924d3a5-9cac-4be9-a246-c91c572c73bf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:19.768055 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c924d3a5-9cac-4be9-a246-c91c572c73bf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:19.774645 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c924d3a5-9cac-4be9-a246-c91c572c73bf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:19.775121 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c924d3a5-9cac-4be9-a246-c91c572c73bf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:19.775879 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c924d3a5-9cac-4be9-a246-c91c572c73bf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:19.776316 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c924d3a5-9cac-4be9-a246-c91c572c73bf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:19.804580 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c924d3a5-9cac-4be9-a246-c91c572c73bf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041401 Jun 16 19:48:19.805122 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 372/766] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:19 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:20.023308 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-20de5809-c687-4c8c-9720-2927f659c807 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:20.024018 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-20de5809-c687-4c8c-9720-2927f659c807 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:20.030526 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-20de5809-c687-4c8c-9720-2927f659c807 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:20.031185 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-20de5809-c687-4c8c-9720-2927f659c807 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:20.031960 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-20de5809-c687-4c8c-9720-2927f659c807 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:20.032398 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-20de5809-c687-4c8c-9720-2927f659c807 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:20.114259 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-28bd143c-f8c2-4466-9545-a5c4b07e212b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:20.114871 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-28bd143c-f8c2-4466-9545-a5c4b07e212b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:20.117520 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:20.122262 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-28bd143c-f8c2-4466-9545-a5c4b07e212b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:20.122710 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-28bd143c-f8c2-4466-9545-a5c4b07e212b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:20.123518 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-28bd143c-f8c2-4466-9545-a5c4b07e212b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:20.123954 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-28bd143c-f8c2-4466-9545-a5c4b07e212b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:20.166048 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-20de5809-c687-4c8c-9720-2927f659c807 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:20.170862 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-20de5809-c687-4c8c-9720-2927f659c807 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:20.172472 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-20de5809-c687-4c8c-9720-2927f659c807 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:20.173771 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-20de5809-c687-4c8c-9720-2927f659c807 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.154994 Jun 16 19:48:20.174392 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 395/767] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:48:20 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:48:20.254791 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-941aeef1-4a7d-4de8-b604-f82c409d0c67 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:20.255636 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-941aeef1-4a7d-4de8-b604-f82c409d0c67 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:20.264742 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-941aeef1-4a7d-4de8-b604-f82c409d0c67 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:20.265282 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-941aeef1-4a7d-4de8-b604-f82c409d0c67 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:20.266169 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-941aeef1-4a7d-4de8-b604-f82c409d0c67 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:20.266588 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-941aeef1-4a7d-4de8-b604-f82c409d0c67 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:20.269320 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-28bd143c-f8c2-4466-9545-a5c4b07e212b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:20.277593 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-28bd143c-f8c2-4466-9545-a5c4b07e212b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.167435 Jun 16 19:48:20.278149 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 373/768] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:20 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:20.396266 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-941aeef1-4a7d-4de8-b604-f82c409d0c67 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:20.404004 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-941aeef1-4a7d-4de8-b604-f82c409d0c67 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.156824 Jun 16 19:48:20.404559 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 396/769] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:20 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:20.659856 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f030f6ea-e3d3-47de-9839-87d2c26e62c3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:20.660462 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f030f6ea-e3d3-47de-9839-87d2c26e62c3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:20.666839 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f030f6ea-e3d3-47de-9839-87d2c26e62c3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:20.668877 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f030f6ea-e3d3-47de-9839-87d2c26e62c3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:20.668877 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f030f6ea-e3d3-47de-9839-87d2c26e62c3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:20.668877 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f030f6ea-e3d3-47de-9839-87d2c26e62c3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:20.672306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:20.804135 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f030f6ea-e3d3-47de-9839-87d2c26e62c3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:20.816740 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-849ca21a-34fb-40b0-9210-f1897829351c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:20.817642 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-849ca21a-34fb-40b0-9210-f1897829351c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:20.822121 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f030f6ea-e3d3-47de-9839-87d2c26e62c3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.165976 Jun 16 19:48:20.823002 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 374/770] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:20 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:20.824455 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-849ca21a-34fb-40b0-9210-f1897829351c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:20.824909 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-849ca21a-34fb-40b0-9210-f1897829351c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:20.825742 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-849ca21a-34fb-40b0-9210-f1897829351c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:20.826179 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-849ca21a-34fb-40b0-9210-f1897829351c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:20.859614 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-849ca21a-34fb-40b0-9210-f1897829351c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047457 Jun 16 19:48:20.860180 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 397/771] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:20 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:21.194240 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1a5bf952-e35b-44a4-bb19-5aaa5219343e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:21.196042 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1a5bf952-e35b-44a4-bb19-5aaa5219343e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:21.202303 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a5bf952-e35b-44a4-bb19-5aaa5219343e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:21.202969 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a5bf952-e35b-44a4-bb19-5aaa5219343e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:21.203745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a5bf952-e35b-44a4-bb19-5aaa5219343e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:21.204178 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a5bf952-e35b-44a4-bb19-5aaa5219343e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:21.294107 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b12cd75e-114b-4f6f-bdbf-0e18effcf2f8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:21.295210 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b12cd75e-114b-4f6f-bdbf-0e18effcf2f8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:21.301006 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b12cd75e-114b-4f6f-bdbf-0e18effcf2f8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:21.301470 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b12cd75e-114b-4f6f-bdbf-0e18effcf2f8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:21.302245 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b12cd75e-114b-4f6f-bdbf-0e18effcf2f8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:21.302686 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b12cd75e-114b-4f6f-bdbf-0e18effcf2f8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:21.420280 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1a5bf952-e35b-44a4-bb19-5aaa5219343e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:21.431163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1a5bf952-e35b-44a4-bb19-5aaa5219343e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:21.433592 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1a5bf952-e35b-44a4-bb19-5aaa5219343e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:21.435784 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1a5bf952-e35b-44a4-bb19-5aaa5219343e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1807 microversion: 2.20 time: 0.246276 Jun 16 19:48:21.447847 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 375/772] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:48:21 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:48:21.452862 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2e836ba2-05dd-4a5b-b55a-74247d927232 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:21.453487 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2e836ba2-05dd-4a5b-b55a-74247d927232 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:21.460902 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e836ba2-05dd-4a5b-b55a-74247d927232 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:21.461354 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e836ba2-05dd-4a5b-b55a-74247d927232 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:21.462139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e836ba2-05dd-4a5b-b55a-74247d927232 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:21.462572 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e836ba2-05dd-4a5b-b55a-74247d927232 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:21.472628 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b12cd75e-114b-4f6f-bdbf-0e18effcf2f8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:21.481276 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b12cd75e-114b-4f6f-bdbf-0e18effcf2f8 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.191484 Jun 16 19:48:21.491917 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 398/773] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:21 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:21.819069 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2e836ba2-05dd-4a5b-b55a-74247d927232 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:21.827006 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2e836ba2-05dd-4a5b-b55a-74247d927232 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.378448 Jun 16 19:48:21.827592 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 376/774] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:21 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:21.839398 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-739c88f1-e54b-4d2b-868b-2cbf72e15079 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:21.840211 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-739c88f1-e54b-4d2b-868b-2cbf72e15079 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:21.846884 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-739c88f1-e54b-4d2b-868b-2cbf72e15079 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:21.847451 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-739c88f1-e54b-4d2b-868b-2cbf72e15079 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:21.848170 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-739c88f1-e54b-4d2b-868b-2cbf72e15079 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:21.848602 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-739c88f1-e54b-4d2b-868b-2cbf72e15079 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:21.871729 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c008d125-4869-49dc-8a86-66929cc463a2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:21.873195 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c008d125-4869-49dc-8a86-66929cc463a2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:21.879381 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c008d125-4869-49dc-8a86-66929cc463a2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:21.879820 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c008d125-4869-49dc-8a86-66929cc463a2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:21.880583 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c008d125-4869-49dc-8a86-66929cc463a2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:21.881056 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c008d125-4869-49dc-8a86-66929cc463a2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:21.915370 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c008d125-4869-49dc-8a86-66929cc463a2 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047533 Jun 16 19:48:21.915948 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 377/775] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:48:21 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 19:48:21.982627 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f11ed56b-332e-4a62-878c-0f034ce7030d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:21.983142 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f11ed56b-332e-4a62-878c-0f034ce7030d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:21.989054 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f11ed56b-332e-4a62-878c-0f034ce7030d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:21.989495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f11ed56b-332e-4a62-878c-0f034ce7030d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:21.990244 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f11ed56b-332e-4a62-878c-0f034ce7030d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:21.990683 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f11ed56b-332e-4a62-878c-0f034ce7030d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:21.996950 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-739c88f1-e54b-4d2b-868b-2cbf72e15079 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:22.004404 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-739c88f1-e54b-4d2b-868b-2cbf72e15079 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1319 microversion: 2.1 time: 0.169134 Jun 16 19:48:22.004971 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 399/776] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:21 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:22.015913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f11ed56b-332e-4a62-878c-0f034ce7030d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Going to try to terminate instance {{(pid=124550) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:48:22.399915 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f11ed56b-332e-4a62-878c-0f034ce7030d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 204 len: 0 microversion: 2.1 time: 0.420771 Jun 16 19:48:22.400600 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 378/777] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:48:21 2022] DELETE /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 19:48:22.408475 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-05fb4d07-b05c-43f4-8746-c105460c72fb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:22.409231 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-05fb4d07-b05c-43f4-8746-c105460c72fb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:22.415395 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05fb4d07-b05c-43f4-8746-c105460c72fb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:22.415851 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05fb4d07-b05c-43f4-8746-c105460c72fb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:22.417340 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05fb4d07-b05c-43f4-8746-c105460c72fb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:22.417789 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05fb4d07-b05c-43f4-8746-c105460c72fb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:22.455979 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-63f785af-c7fd-4992-aceb-07e3fc45d833 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:22.456677 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-63f785af-c7fd-4992-aceb-07e3fc45d833 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:22.463305 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-63f785af-c7fd-4992-aceb-07e3fc45d833 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:22.463752 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-63f785af-c7fd-4992-aceb-07e3fc45d833 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:22.464515 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-63f785af-c7fd-4992-aceb-07e3fc45d833 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:22.464952 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-63f785af-c7fd-4992-aceb-07e3fc45d833 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:22.546223 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-05fb4d07-b05c-43f4-8746-c105460c72fb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:22.554214 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-05fb4d07-b05c-43f4-8746-c105460c72fb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1681 microversion: 2.1 time: 0.149485 Jun 16 19:48:22.554787 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 400/778] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:22 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:22.559363 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3593a293-6c0e-496c-8f3d-b94621b5ec29 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:22.560164 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-3593a293-6c0e-496c-8f3d-b94621b5ec29 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:22.566375 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3593a293-6c0e-496c-8f3d-b94621b5ec29 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:22.567642 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3593a293-6c0e-496c-8f3d-b94621b5ec29 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:22.568854 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3593a293-6c0e-496c-8f3d-b94621b5ec29 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:22.569545 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3593a293-6c0e-496c-8f3d-b94621b5ec29 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:22.617453 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-63f785af-c7fd-4992-aceb-07e3fc45d833 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:22.630654 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-63f785af-c7fd-4992-aceb-07e3fc45d833 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:22.632725 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-63f785af-c7fd-4992-aceb-07e3fc45d833 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:22.633910 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-63f785af-c7fd-4992-aceb-07e3fc45d833 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1794 microversion: 2.20 time: 0.182129 Jun 16 19:48:22.634665 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 379/779] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:48:22 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1794 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:48:22.703231 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3593a293-6c0e-496c-8f3d-b94621b5ec29 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:22.712425 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-3593a293-6c0e-496c-8f3d-b94621b5ec29 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.156558 Jun 16 19:48:22.712952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 401/780] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:22 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:22.842900 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a04981bc-155f-40d9-a6f9-f470ed155142 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:22.843605 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a04981bc-155f-40d9-a6f9-f470ed155142 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:22.849537 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a04981bc-155f-40d9-a6f9-f470ed155142 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:22.849986 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a04981bc-155f-40d9-a6f9-f470ed155142 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:22.850740 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a04981bc-155f-40d9-a6f9-f470ed155142 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:22.851202 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a04981bc-155f-40d9-a6f9-f470ed155142 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:22.982245 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a04981bc-155f-40d9-a6f9-f470ed155142 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:22.989637 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a04981bc-155f-40d9-a6f9-f470ed155142 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.150551 Jun 16 19:48:22.990260 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 380/781] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:22 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:23.021085 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-529d1460-1b49-4a71-b8c4-cbc9c984f6a3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:23.021696 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-529d1460-1b49-4a71-b8c4-cbc9c984f6a3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:23.028172 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-529d1460-1b49-4a71-b8c4-cbc9c984f6a3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:23.028622 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-529d1460-1b49-4a71-b8c4-cbc9c984f6a3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:23.029380 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-529d1460-1b49-4a71-b8c4-cbc9c984f6a3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:23.029847 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-529d1460-1b49-4a71-b8c4-cbc9c984f6a3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:23.157417 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-529d1460-1b49-4a71-b8c4-cbc9c984f6a3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:23.165245 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-529d1460-1b49-4a71-b8c4-cbc9c984f6a3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1508 microversion: 2.1 time: 0.147932 Jun 16 19:48:23.165814 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 402/782] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:23 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:23.182013 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ca216bc1-6c7b-4be3-8ab4-2ba5c4c38165 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee689f9f-8c58-40db-b418-50c68d8d2ec2", "device": "/dev/sdb"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:48:23.183552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ca216bc1-6c7b-4be3-8ab4-2ba5c4c38165 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:23.189591 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ca216bc1-6c7b-4be3-8ab4-2ba5c4c38165 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:23.190030 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ca216bc1-6c7b-4be3-8ab4-2ba5c4c38165 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:23.190783 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ca216bc1-6c7b-4be3-8ab4-2ba5c4c38165 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:23.191244 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ca216bc1-6c7b-4be3-8ab4-2ba5c4c38165 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:23.571517 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-05f4bd40-1c31-4ec3-aaae-4c1baffdf134 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:23.572134 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-05f4bd40-1c31-4ec3-aaae-4c1baffdf134 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:23.578104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05f4bd40-1c31-4ec3-aaae-4c1baffdf134 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:23.578551 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05f4bd40-1c31-4ec3-aaae-4c1baffdf134 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:23.579337 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05f4bd40-1c31-4ec3-aaae-4c1baffdf134 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:23.579772 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-05f4bd40-1c31-4ec3-aaae-4c1baffdf134 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:23.712801 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-05f4bd40-1c31-4ec3-aaae-4c1baffdf134 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:23.720253 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-05f4bd40-1c31-4ec3-aaae-4c1baffdf134 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1681 microversion: 2.1 time: 0.152915 Jun 16 19:48:23.720816 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 403/783] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:23 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:23.725244 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0295fa91-9f3e-404c-820b-253b013a3409 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:48:23.726793 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0295fa91-9f3e-404c-820b-253b013a3409 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:23.732510 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0295fa91-9f3e-404c-820b-253b013a3409 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:23.732957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0295fa91-9f3e-404c-820b-253b013a3409 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:23.733728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0295fa91-9f3e-404c-820b-253b013a3409 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:23.734152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0295fa91-9f3e-404c-820b-253b013a3409 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:24.036482 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0295fa91-9f3e-404c-820b-253b013a3409 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "POST /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/action" status: 202 len: 0 microversion: 2.1 time: 0.314426 Jun 16 19:48:24.037111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 404/784] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Jun 16 19:48:23 2022] POST /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:48:24.042634 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-eee74934-4fbc-4d24-b699-e88ca7b7f0d1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:24.043356 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-eee74934-4fbc-4d24-b699-e88ca7b7f0d1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:24.049330 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eee74934-4fbc-4d24-b699-e88ca7b7f0d1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:24.049772 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eee74934-4fbc-4d24-b699-e88ca7b7f0d1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:24.050519 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eee74934-4fbc-4d24-b699-e88ca7b7f0d1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:24.050970 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eee74934-4fbc-4d24-b699-e88ca7b7f0d1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:24.181326 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-eee74934-4fbc-4d24-b699-e88ca7b7f0d1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:24.189401 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-eee74934-4fbc-4d24-b699-e88ca7b7f0d1 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1735 microversion: 2.1 time: 0.151105 Jun 16 19:48:24.189955 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 405/785] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:24 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:24.195370 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-25b3a52f-8a1e-4d88-8731-ca2eb647c917 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:24.196071 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-25b3a52f-8a1e-4d88-8731-ca2eb647c917 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:24.201748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-25b3a52f-8a1e-4d88-8731-ca2eb647c917 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:24.202188 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-25b3a52f-8a1e-4d88-8731-ca2eb647c917 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:24.202992 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-25b3a52f-8a1e-4d88-8731-ca2eb647c917 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:24.203422 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-25b3a52f-8a1e-4d88-8731-ca2eb647c917 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:24.328432 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-25b3a52f-8a1e-4d88-8731-ca2eb647c917 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:24.335742 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-25b3a52f-8a1e-4d88-8731-ca2eb647c917 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.144800 Jun 16 19:48:24.336296 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 406/786] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:24 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:24.340610 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-2a4f8627-10e9-4365-acf9-e7d7601905e5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:24.341226 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-2a4f8627-10e9-4365-acf9-e7d7601905e5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:24.346672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2a4f8627-10e9-4365-acf9-e7d7601905e5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:24.347153 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2a4f8627-10e9-4365-acf9-e7d7601905e5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:24.347896 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2a4f8627-10e9-4365-acf9-e7d7601905e5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:24.348326 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2a4f8627-10e9-4365-acf9-e7d7601905e5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:24.488593 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-2a4f8627-10e9-4365-acf9-e7d7601905e5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:24.496376 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-2a4f8627-10e9-4365-acf9-e7d7601905e5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1750 microversion: 2.1 time: 0.159163 Jun 16 19:48:24.496928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 407/787] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:24 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:24.737789 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-2d996685-41cd-4abd-9193-d83f1b50db93 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:24.738486 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-2d996685-41cd-4abd-9193-d83f1b50db93 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:24.744750 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2d996685-41cd-4abd-9193-d83f1b50db93 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:24.745202 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2d996685-41cd-4abd-9193-d83f1b50db93 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:24.755903 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2d996685-41cd-4abd-9193-d83f1b50db93 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:24.755903 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2d996685-41cd-4abd-9193-d83f1b50db93 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:24.766397 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:24.893066 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-2d996685-41cd-4abd-9193-d83f1b50db93 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:24.901012 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-2d996685-41cd-4abd-9193-d83f1b50db93 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1681 microversion: 2.1 time: 0.167265 Jun 16 19:48:24.901577 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 408/788] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:24 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:24.905823 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-00bc7b16-676f-4cf4-8f04-68795172793b req-5fd5582a-1ca5-48d4-972d-1c30d1ae872f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1303e37f-ab18-42db-8f6f-dfe6580c7b0f", "name": "network-vif-plugged", "status": "completed", "tag": "a195dea2-c192-44c9-a838-68ed16f657df"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:48:24.913689 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-00bc7b16-676f-4cf4-8f04-68795172793b req-5fd5582a-1ca5-48d4-972d-1c30d1ae872f service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:24.914370 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-00bc7b16-676f-4cf4-8f04-68795172793b req-5fd5582a-1ca5-48d4-972d-1c30d1ae872f service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:24.925611 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-00bc7b16-676f-4cf4-8f04-68795172793b req-5fd5582a-1ca5-48d4-972d-1c30d1ae872f service nova] Creating event network-vif-plugged:a195dea2-c192-44c9-a838-68ed16f657df for instance 1303e37f-ab18-42db-8f6f-dfe6580c7b0f on hv-cinder-84617 Jun 16 19:48:24.931676 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-00bc7b16-676f-4cf4-8f04-68795172793b req-5fd5582a-1ca5-48d4-972d-1c30d1ae872f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028846 Jun 16 19:48:24.950683 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 409/789] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:25.208109 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-848b29e2-800f-4be2-a055-1472e55bb770 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:25.208816 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-848b29e2-800f-4be2-a055-1472e55bb770 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:25.216262 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-848b29e2-800f-4be2-a055-1472e55bb770 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:25.216714 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-848b29e2-800f-4be2-a055-1472e55bb770 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:25.217481 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-848b29e2-800f-4be2-a055-1472e55bb770 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:25.217917 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-848b29e2-800f-4be2-a055-1472e55bb770 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:25.347118 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-848b29e2-800f-4be2-a055-1472e55bb770 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:25.358130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-848b29e2-800f-4be2-a055-1472e55bb770 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1715 microversion: 2.1 time: 0.154639 Jun 16 19:48:25.358714 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 410/790] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:25 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:25.367496 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c22ec98b-2121-4837-aa6a-249d941df2e8 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:25.368995 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c22ec98b-2121-4837-aa6a-249d941df2e8 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:25.378230 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c22ec98b-2121-4837-aa6a-249d941df2e8 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:25.378230 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c22ec98b-2121-4837-aa6a-249d941df2e8 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:25.379030 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c22ec98b-2121-4837-aa6a-249d941df2e8 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:25.379473 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c22ec98b-2121-4837-aa6a-249d941df2e8 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:25.537386 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c22ec98b-2121-4837-aa6a-249d941df2e8 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:25.544956 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c22ec98b-2121-4837-aa6a-249d941df2e8 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.185229 Jun 16 19:48:25.545561 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 411/791] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:25 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:25.550479 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3a6b1775-ae03-4205-936a-afa25a61fbf6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:25.550994 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-3a6b1775-ae03-4205-936a-afa25a61fbf6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:25.557541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3a6b1775-ae03-4205-936a-afa25a61fbf6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:25.557984 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3a6b1775-ae03-4205-936a-afa25a61fbf6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:25.558746 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3a6b1775-ae03-4205-936a-afa25a61fbf6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:25.559207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3a6b1775-ae03-4205-936a-afa25a61fbf6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:25.647231 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-3a6b1775-ae03-4205-936a-afa25a61fbf6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] HTTP exception thrown: Cannot 'detach_volume' instance ea242cf7-0535-4532-aaa0-59848bf41c73 while it is in vm_state rescued Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3a6b1775-ae03-4205-936a-afa25a61fbf6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Request method failure captured: Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: DELETE /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/os-volume_attachments/934bcd4e-feb8-42b0-904d-450591281c81 HTTP/1.1 Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4f2bJrSUVHDMMTqU2Jad-fuYa-ofXk1y9tRV-Se49xlEwwcbihzp3u5EHqEbpzFBj_5sSZbxubYd39VX764172H-VM9cSazwalfJq36RSCcub4-RnQ89lgkzUX_84lIDug8hDGmNJ1OxRyHEdc235OBU20Fo3EaYIsAMLvUvs-yb6k Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 7153c09b2d0b4805ad0360afb7ecd3ca Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-842795293 Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:48:25.649652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:48:25.651184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7153c09b2d0b4805ad0360afb7ecd3ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7153c09b2d0b4805ad0360afb7ecd3ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7153c09b2d0b4805ad0360afb7ecd3ca", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7153c09b2d0b4805ad0360afb7ecd3ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:48:25.651184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-ServerRescueNegativeTestJSON-842795293 Jun 16 19:48:25.651184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 7153c09b2d0b4805ad0360afb7ecd3ca Jun 16 19:48:25.651184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-842795293 Jun 16 19:48:25.651184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-ServerRescueNegativeTestJSON-842795293-project Jun 16 19:48:25.651184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:48:25.651184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:48:25.651184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 2d0d5723417d4b60bc51e47f28d09902 Jun 16 19:48:25.651184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-ServerRescueNegativeTestJSON-842795293-project Jun 16 19:48:25.651184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:48:25.651184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Cannot 'detach_volume' instance ea242cf7-0535-4532-aaa0-59848bf41c73 while it is in vm_state rescued Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'server_id': 'ea242cf7-0535-4532-aaa0-59848bf41c73', 'id': '934bcd4e-feb8-42b0-904d-450591281c81'} Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ea242cf7-0535-4532-aaa0-59848bf41c73 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:48:25.651891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:48:25.654033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 19:48:25.654033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 19:48:25.654033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 19:48:25.654033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 19:48:25.654033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ea242cf7-0535-4532-aaa0-59848bf41c73 while it is in vm_state rescued Jun 16 19:48:25.654033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:48:25.654033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:48:25.654033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:48:25.654033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:48:25.654033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:48:25.654033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:48:25.654033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:48:25.654033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:48:25.654033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ea242cf7-0535-4532-aaa0-59848bf41c73 while it is in vm_state rescued Jun 16 19:48:25.654033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:48:25.654033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3a6b1775-ae03-4205-936a-afa25a61fbf6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Returning 409 to user: Cannot 'detach_volume' instance ea242cf7-0535-4532-aaa0-59848bf41c73 while it is in vm_state rescued {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:48:25.657179 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-3a6b1775-ae03-4205-936a-afa25a61fbf6 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/os-volume_attachments/934bcd4e-feb8-42b0-904d-450591281c81" status: 409 len: 152 microversion: 2.1 time: 0.104715 Jun 16 19:48:25.657179 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 412/792] 10.222.0.36 () {58 vars in 1415 bytes} [Thu Jun 16 19:48:25 2022] DELETE /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/os-volume_attachments/934bcd4e-feb8-42b0-904d-450591281c81 => generated 152 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 19:48:25.657756 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7f14dcf8-738e-4daf-95f7-49e5e4dcc648 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:25.658310 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-7f14dcf8-738e-4daf-95f7-49e5e4dcc648 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:25.665193 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7f14dcf8-738e-4daf-95f7-49e5e4dcc648 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:25.665587 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7f14dcf8-738e-4daf-95f7-49e5e4dcc648 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:25.666363 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7f14dcf8-738e-4daf-95f7-49e5e4dcc648 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:25.669523 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7f14dcf8-738e-4daf-95f7-49e5e4dcc648 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:25.835975 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-7f14dcf8-738e-4daf-95f7-49e5e4dcc648 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:25.845043 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-7f14dcf8-738e-4daf-95f7-49e5e4dcc648 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1750 microversion: 2.1 time: 0.191826 Jun 16 19:48:25.845734 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 413/793] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:25 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1750 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:25.860225 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-454812ac-31bc-4c76-b4b9-abf772656970 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:48:25.861408 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-454812ac-31bc-4c76-b4b9-abf772656970 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:25.868342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-454812ac-31bc-4c76-b4b9-abf772656970 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:25.868806 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-454812ac-31bc-4c76-b4b9-abf772656970 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:25.869718 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-454812ac-31bc-4c76-b4b9-abf772656970 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:25.870264 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-454812ac-31bc-4c76-b4b9-abf772656970 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:26.162678 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-454812ac-31bc-4c76-b4b9-abf772656970 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "POST /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/action" status: 202 len: 0 microversion: 2.1 time: 0.306229 Jun 16 19:48:26.163915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 414/794] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Jun 16 19:48:25 2022] POST /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:48:26.170626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e4ee5cfc-b757-4461-ae5c-2db6a091356d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:26.171517 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e4ee5cfc-b757-4461-ae5c-2db6a091356d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:26.178193 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e4ee5cfc-b757-4461-ae5c-2db6a091356d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:26.184533 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e4ee5cfc-b757-4461-ae5c-2db6a091356d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:26.184533 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e4ee5cfc-b757-4461-ae5c-2db6a091356d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:26.184533 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e4ee5cfc-b757-4461-ae5c-2db6a091356d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:26.268644 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ca216bc1-6c7b-4be3-8ab4-2ba5c4c38165 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "POST /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.089204 Jun 16 19:48:26.286485 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 381/795] 10.222.0.36 () {60 vars in 1322 bytes} [Thu Jun 16 19:48:23 2022] POST /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319/os-volume_attachments => generated 194 bytes in 3109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:26.301991 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-71d5520f-c9de-4dd8-a8a8-55a7f825d545 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:26.302883 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-71d5520f-c9de-4dd8-a8a8-55a7f825d545 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:26.314113 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-71d5520f-c9de-4dd8-a8a8-55a7f825d545 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:26.317833 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-71d5520f-c9de-4dd8-a8a8-55a7f825d545 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:26.320586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-71d5520f-c9de-4dd8-a8a8-55a7f825d545 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:26.322217 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-71d5520f-c9de-4dd8-a8a8-55a7f825d545 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:26.328126 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e4ee5cfc-b757-4461-ae5c-2db6a091356d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:26.340153 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e4ee5cfc-b757-4461-ae5c-2db6a091356d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1681 microversion: 2.1 time: 0.174742 Jun 16 19:48:26.341078 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 415/796] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:26 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:26.464273 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-71d5520f-c9de-4dd8-a8a8-55a7f825d545 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:26.472410 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-71d5520f-c9de-4dd8-a8a8-55a7f825d545 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1723 microversion: 2.1 time: 0.184331 Jun 16 19:48:26.473863 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 382/797] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:26 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:26.562012 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-66f7f2fd-149a-4024-a91c-86204163992f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:26.562872 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-66f7f2fd-149a-4024-a91c-86204163992f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:26.569265 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-66f7f2fd-149a-4024-a91c-86204163992f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:26.569716 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-66f7f2fd-149a-4024-a91c-86204163992f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:26.571887 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-66f7f2fd-149a-4024-a91c-86204163992f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:26.572335 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-66f7f2fd-149a-4024-a91c-86204163992f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:26.751947 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-66f7f2fd-149a-4024-a91c-86204163992f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:26.766654 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-66f7f2fd-149a-4024-a91c-86204163992f tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.208436 Jun 16 19:48:26.778744 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 416/798] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:26 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:26.843481 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-0bbd5fbc-4d07-4247-8a52-1df48dd67b39 req-b24f4bba-b91d-4e63-8f74-62a2741bdcdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c939c84-1712-4551-a3e3-cf42be4113fe", "name": "network-vif-deleted", "tag": "24f9795e-d76d-4b2b-8ac3-7a285df7d774"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:48:26.867405 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1bde10dd-9650-4a60-b9ea-ba6e535ee596 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:26.868180 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-1bde10dd-9650-4a60-b9ea-ba6e535ee596 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:26.880394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-0bbd5fbc-4d07-4247-8a52-1df48dd67b39 req-b24f4bba-b91d-4e63-8f74-62a2741bdcdc service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:26.881397 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-0bbd5fbc-4d07-4247-8a52-1df48dd67b39 req-b24f4bba-b91d-4e63-8f74-62a2741bdcdc service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:26.885756 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1bde10dd-9650-4a60-b9ea-ba6e535ee596 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:26.888029 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1bde10dd-9650-4a60-b9ea-ba6e535ee596 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:26.890385 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1bde10dd-9650-4a60-b9ea-ba6e535ee596 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:26.891565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1bde10dd-9650-4a60-b9ea-ba6e535ee596 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:26.911912 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-0bbd5fbc-4d07-4247-8a52-1df48dd67b39 req-b24f4bba-b91d-4e63-8f74-62a2741bdcdc service nova] Creating event network-vif-deleted:24f9795e-d76d-4b2b-8ac3-7a285df7d774 for instance 5c939c84-1712-4551-a3e3-cf42be4113fe on hv-cinder-84617 Jun 16 19:48:26.924606 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-0bbd5fbc-4d07-4247-8a52-1df48dd67b39 req-b24f4bba-b91d-4e63-8f74-62a2741bdcdc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087803 Jun 16 19:48:26.926739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 383/799] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:27.097901 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1bde10dd-9650-4a60-b9ea-ba6e535ee596 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:27.106709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-1bde10dd-9650-4a60-b9ea-ba6e535ee596 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1750 microversion: 2.1 time: 0.248787 Jun 16 19:48:27.107691 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 417/800] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:26 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1750 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:27.359561 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0fdd186b-ba5f-4ac9-84ab-7382034d2d99 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:27.360221 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0fdd186b-ba5f-4ac9-84ab-7382034d2d99 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:27.366973 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0fdd186b-ba5f-4ac9-84ab-7382034d2d99 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:27.367423 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0fdd186b-ba5f-4ac9-84ab-7382034d2d99 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:27.368179 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0fdd186b-ba5f-4ac9-84ab-7382034d2d99 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:27.368613 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0fdd186b-ba5f-4ac9-84ab-7382034d2d99 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:27.439037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0fdd186b-ba5f-4ac9-84ab-7382034d2d99 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:27.448005 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0fdd186b-ba5f-4ac9-84ab-7382034d2d99 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1326 microversion: 2.1 time: 0.092851 Jun 16 19:48:27.448771 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 384/801] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:27 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1326 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:27.489694 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d81963e1-24f9-4bc8-b9dc-51a2a1515e68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:27.490310 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d81963e1-24f9-4bc8-b9dc-51a2a1515e68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:27.496848 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d81963e1-24f9-4bc8-b9dc-51a2a1515e68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:27.497305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d81963e1-24f9-4bc8-b9dc-51a2a1515e68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:27.498075 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d81963e1-24f9-4bc8-b9dc-51a2a1515e68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:27.498511 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d81963e1-24f9-4bc8-b9dc-51a2a1515e68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:27.786063 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c53e3773-d4a9-42a3-a25e-9a37bcf45b4d tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:27.789522 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c53e3773-d4a9-42a3-a25e-9a37bcf45b4d tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:27.800948 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c53e3773-d4a9-42a3-a25e-9a37bcf45b4d tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:27.801700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c53e3773-d4a9-42a3-a25e-9a37bcf45b4d tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:27.802680 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c53e3773-d4a9-42a3-a25e-9a37bcf45b4d tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:27.803473 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c53e3773-d4a9-42a3-a25e-9a37bcf45b4d tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:27.992239 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d81963e1-24f9-4bc8-b9dc-51a2a1515e68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:28.000151 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d81963e1-24f9-4bc8-b9dc-51a2a1515e68 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1723 microversion: 2.1 time: 0.514398 Jun 16 19:48:28.000724 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 418/802] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:27 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1723 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:28.002997 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c53e3773-d4a9-42a3-a25e-9a37bcf45b4d tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:28.010778 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c53e3773-d4a9-42a3-a25e-9a37bcf45b4d tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1314 microversion: 2.1 time: 0.230031 Jun 16 19:48:28.011394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 385/803] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:27 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:28.124059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f26a9133-f2be-4aa6-8a5c-63a31e60c908 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:28.124678 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f26a9133-f2be-4aa6-8a5c-63a31e60c908 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:28.130574 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f26a9133-f2be-4aa6-8a5c-63a31e60c908 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:28.131059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f26a9133-f2be-4aa6-8a5c-63a31e60c908 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:28.132322 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f26a9133-f2be-4aa6-8a5c-63a31e60c908 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:28.132760 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f26a9133-f2be-4aa6-8a5c-63a31e60c908 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:28.274445 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f26a9133-f2be-4aa6-8a5c-63a31e60c908 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:28.282430 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f26a9133-f2be-4aa6-8a5c-63a31e60c908 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1750 microversion: 2.1 time: 0.162320 Jun 16 19:48:28.283008 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 419/804] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:28 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:28.465697 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e2d6c7e2-926d-47e3-ad68-2bd8c731b7a5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:28.466331 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e2d6c7e2-926d-47e3-ad68-2bd8c731b7a5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:28.476992 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e2d6c7e2-926d-47e3-ad68-2bd8c731b7a5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:28.476992 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e2d6c7e2-926d-47e3-ad68-2bd8c731b7a5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:28.476992 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e2d6c7e2-926d-47e3-ad68-2bd8c731b7a5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:28.476992 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e2d6c7e2-926d-47e3-ad68-2bd8c731b7a5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:28.507984 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e2d6c7e2-926d-47e3-ad68-2bd8c731b7a5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:28.508430 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e2d6c7e2-926d-47e3-ad68-2bd8c731b7a5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:28.508880 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-e2d6c7e2-926d-47e3-ad68-2bd8c731b7a5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lazy-loading 'fault' on Instance uuid 5c939c84-1712-4551-a3e3-cf42be4113fe {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:48:28.548940 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e2d6c7e2-926d-47e3-ad68-2bd8c731b7a5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:28.556857 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e2d6c7e2-926d-47e3-ad68-2bd8c731b7a5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1331 microversion: 2.1 time: 0.095103 Jun 16 19:48:28.557717 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 386/805] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:28 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:29.017649 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-476e34b5-9bde-4bb4-803b-8fd741c3f3a4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:29.018244 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-476e34b5-9bde-4bb4-803b-8fd741c3f3a4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:29.025563 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-476e34b5-9bde-4bb4-803b-8fd741c3f3a4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:29.026006 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-476e34b5-9bde-4bb4-803b-8fd741c3f3a4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:29.026766 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-476e34b5-9bde-4bb4-803b-8fd741c3f3a4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:29.027228 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-476e34b5-9bde-4bb4-803b-8fd741c3f3a4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:29.027556 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3df87cb8-f01d-487a-a5c1-9456fb65464d tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:29.028173 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3df87cb8-f01d-487a-a5c1-9456fb65464d tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:29.034502 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3df87cb8-f01d-487a-a5c1-9456fb65464d tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:29.034976 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3df87cb8-f01d-487a-a5c1-9456fb65464d tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:29.035741 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3df87cb8-f01d-487a-a5c1-9456fb65464d tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:29.036174 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3df87cb8-f01d-487a-a5c1-9456fb65464d tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:29.154311 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-476e34b5-9bde-4bb4-803b-8fd741c3f3a4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:29.166577 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-476e34b5-9bde-4bb4-803b-8fd741c3f3a4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1723 microversion: 2.1 time: 0.148513 Jun 16 19:48:29.166577 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 420/806] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:29 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:29.166997 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3df87cb8-f01d-487a-a5c1-9456fb65464d tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:29.173343 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3df87cb8-f01d-487a-a5c1-9456fb65464d tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1464 microversion: 2.1 time: 0.149486 Jun 16 19:48:29.173899 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 387/807] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:29 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:29.211606 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-67f2526f-8a4b-4a17-8210-3675931bb8f3 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:29.212133 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-67f2526f-8a4b-4a17-8210-3675931bb8f3 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:29.218100 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-67f2526f-8a4b-4a17-8210-3675931bb8f3 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:29.218551 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-67f2526f-8a4b-4a17-8210-3675931bb8f3 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:29.219346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-67f2526f-8a4b-4a17-8210-3675931bb8f3 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:29.219782 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-67f2526f-8a4b-4a17-8210-3675931bb8f3 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:29.244033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-67f2526f-8a4b-4a17-8210-3675931bb8f3 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Going to try to terminate instance {{(pid=124551) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:48:29.306740 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e07b8a76-b722-40f2-b5c7-804445c72016 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:29.306740 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e07b8a76-b722-40f2-b5c7-804445c72016 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:29.306740 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e07b8a76-b722-40f2-b5c7-804445c72016 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:29.306740 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e07b8a76-b722-40f2-b5c7-804445c72016 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:29.307163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e07b8a76-b722-40f2-b5c7-804445c72016 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:29.307555 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e07b8a76-b722-40f2-b5c7-804445c72016 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:29.311544 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:29.458163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e07b8a76-b722-40f2-b5c7-804445c72016 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:29.467095 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e07b8a76-b722-40f2-b5c7-804445c72016 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1755 microversion: 2.1 time: 0.171541 Jun 16 19:48:29.467705 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 388/808] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:29 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:29.574978 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b7da39ef-4a92-4708-93f8-68a62f784cb9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:29.575525 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b7da39ef-4a92-4708-93f8-68a62f784cb9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:29.581681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7da39ef-4a92-4708-93f8-68a62f784cb9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:29.582149 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7da39ef-4a92-4708-93f8-68a62f784cb9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:29.582896 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7da39ef-4a92-4708-93f8-68a62f784cb9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:29.583501 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7da39ef-4a92-4708-93f8-68a62f784cb9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:29.617094 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7da39ef-4a92-4708-93f8-68a62f784cb9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:29.617610 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7da39ef-4a92-4708-93f8-68a62f784cb9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:29.618066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-b7da39ef-4a92-4708-93f8-68a62f784cb9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lazy-loading 'fault' on Instance uuid 5c939c84-1712-4551-a3e3-cf42be4113fe {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:48:29.658520 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b7da39ef-4a92-4708-93f8-68a62f784cb9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:29.665727 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b7da39ef-4a92-4708-93f8-68a62f784cb9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 200 len: 1331 microversion: 2.1 time: 0.094715 Jun 16 19:48:29.666283 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 389/809] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:29 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:29.764824 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-67f2526f-8a4b-4a17-8210-3675931bb8f3 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 204 len: 0 microversion: 2.1 time: 0.557207 Jun 16 19:48:29.765404 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 421/810] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:48:29 2022] DELETE /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:48:29.773774 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-37e7cedd-6e0a-446e-80d3-4987e9f70b44 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:29.774383 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-37e7cedd-6e0a-446e-80d3-4987e9f70b44 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:29.780658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-37e7cedd-6e0a-446e-80d3-4987e9f70b44 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:29.781102 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-37e7cedd-6e0a-446e-80d3-4987e9f70b44 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:29.781850 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-37e7cedd-6e0a-446e-80d3-4987e9f70b44 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:29.782281 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-37e7cedd-6e0a-446e-80d3-4987e9f70b44 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:29.911863 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-37e7cedd-6e0a-446e-80d3-4987e9f70b44 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:29.919104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-37e7cedd-6e0a-446e-80d3-4987e9f70b44 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1470 microversion: 2.1 time: 0.149387 Jun 16 19:48:29.919667 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 390/811] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:29 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:30.179594 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a8235bae-c921-45bd-a388-7de58bf16ff2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:30.180297 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a8235bae-c921-45bd-a388-7de58bf16ff2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:30.187203 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a8235bae-c921-45bd-a388-7de58bf16ff2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:30.187655 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a8235bae-c921-45bd-a388-7de58bf16ff2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:30.188420 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a8235bae-c921-45bd-a388-7de58bf16ff2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:30.188855 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a8235bae-c921-45bd-a388-7de58bf16ff2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:30.341370 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a8235bae-c921-45bd-a388-7de58bf16ff2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:30.341370 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a8235bae-c921-45bd-a388-7de58bf16ff2 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1723 microversion: 2.1 time: 0.159427 Jun 16 19:48:30.341370 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 422/812] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:30 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:30.484987 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f5410e10-89b6-48ef-8d35-664eb762aff0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:30.485596 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f5410e10-89b6-48ef-8d35-664eb762aff0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:30.492880 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f5410e10-89b6-48ef-8d35-664eb762aff0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:30.493325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f5410e10-89b6-48ef-8d35-664eb762aff0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:30.494074 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f5410e10-89b6-48ef-8d35-664eb762aff0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:30.494536 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f5410e10-89b6-48ef-8d35-664eb762aff0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:30.637650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f5410e10-89b6-48ef-8d35-664eb762aff0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:30.645963 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f5410e10-89b6-48ef-8d35-664eb762aff0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1755 microversion: 2.1 time: 0.164834 Jun 16 19:48:30.646520 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 391/813] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:30 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:30.682140 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-52253e59-a61b-4219-9851-464b9241d7aa tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:30.682947 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-52253e59-a61b-4219-9851-464b9241d7aa tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:30.688702 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-52253e59-a61b-4219-9851-464b9241d7aa tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:30.689143 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-52253e59-a61b-4219-9851-464b9241d7aa tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:30.689889 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-52253e59-a61b-4219-9851-464b9241d7aa tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:30.690326 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-52253e59-a61b-4219-9851-464b9241d7aa tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:30.695063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:30.705645 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-52253e59-a61b-4219-9851-464b9241d7aa tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] HTTP exception thrown: Instance 5c939c84-1712-4551-a3e3-cf42be4113fe could not be found. Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-52253e59-a61b-4219-9851-464b9241d7aa tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Request method failure captured: Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe HTTP/1.1 Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4fyBPW6I9Gw6XK8Mc3wtez0zYsc4UrjgW7z4WtApzgBYkrjjskhl3gYkWnE6yWJE5ICrDHXLgUYO-0AGzBAc7qg6XibMR0r_JEUP5LVfGl7WyQCTm5mkF0v4IWKdbz7Ao2NSIM42ZaaFkj5iXJmRir4voVV15buKmDOb_Ti4CHFnHY Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:48:30.707281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:48:30.708898 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47a4ab888dd74218ab5d7812ad095371", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:48:30.708898 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:48:30.708898 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:48:30.708898 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:48:30.708898 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:48:30.708898 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:48:30.708898 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:48:30.708898 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 4df05cbf303c4524a665b429f240a17a Jun 16 19:48:30.708898 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:48:30.708898 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:48:30.708898 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance 5c939c84-1712-4551-a3e3-cf42be4113fe could not be found. Jun 16 19:48:30.708898 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': '5c939c84-1712-4551-a3e3-cf42be4113fe'} Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c939c84-1712-4551-a3e3-cf42be4113fe could not be found. Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:48:30.710053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:48:30.711719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:48:30.711719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:48:30.711719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:48:30.711719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:48:30.711719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:48:30.711719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:48:30.711719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:48:30.711719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c939c84-1712-4551-a3e3-cf42be4113fe could not be found. Jun 16 19:48:30.711719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:48:30.711719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:48:30.711719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:48:30.711719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:48:30.711719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:48:30.711719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:48:30.711719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:48:30.711719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:48:30.711719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c939c84-1712-4551-a3e3-cf42be4113fe could not be found. Jun 16 19:48:30.711719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:48:30.713451 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-52253e59-a61b-4219-9851-464b9241d7aa tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Returning 404 to user: Instance 5c939c84-1712-4551-a3e3-cf42be4113fe could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:48:30.713451 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-52253e59-a61b-4219-9851-464b9241d7aa tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 404 len: 111 microversion: 2.1 time: 0.030949 Jun 16 19:48:30.713451 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 423/814] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:30 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:48:30.717407 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5b03ea8e-b2d9-4fdb-91bf-fc3d425e14eb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '.version_select at 0x7f05014b5040>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:30.885678 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5b03ea8e-b2d9-4fdb-91bf-fc3d425e14eb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-227914864" status: 202 len: 0 microversion: 2.1 time: 0.171933 Jun 16 19:48:30.886270 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 392/815] 10.222.0.36 () {58 vars in 1217 bytes} [Thu Jun 16 19:48:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-227914864 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:48:30.936660 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-68237f85-df01-424d-9ffa-6b80cff877d7 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:30.937268 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-68237f85-df01-424d-9ffa-6b80cff877d7 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:30.944435 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-68237f85-df01-424d-9ffa-6b80cff877d7 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:30.944875 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-68237f85-df01-424d-9ffa-6b80cff877d7 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:30.945629 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-68237f85-df01-424d-9ffa-6b80cff877d7 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:30.946059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-68237f85-df01-424d-9ffa-6b80cff877d7 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:31.073140 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-68237f85-df01-424d-9ffa-6b80cff877d7 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:31.080077 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-68237f85-df01-424d-9ffa-6b80cff877d7 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1470 microversion: 2.1 time: 0.147449 Jun 16 19:48:31.080639 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 424/816] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:30 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:31.353255 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bf45020b-f3f9-4d3f-8ba9-1c614d7d8662 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:31.353975 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-bf45020b-f3f9-4d3f-8ba9-1c614d7d8662 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:31.359991 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bf45020b-f3f9-4d3f-8ba9-1c614d7d8662 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:31.360507 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bf45020b-f3f9-4d3f-8ba9-1c614d7d8662 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:31.361260 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bf45020b-f3f9-4d3f-8ba9-1c614d7d8662 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:31.361691 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bf45020b-f3f9-4d3f-8ba9-1c614d7d8662 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:31.492510 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-bf45020b-f3f9-4d3f-8ba9-1c614d7d8662 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:31.500235 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-bf45020b-f3f9-4d3f-8ba9-1c614d7d8662 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1723 microversion: 2.1 time: 0.151530 Jun 16 19:48:31.504634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 393/817] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:31 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:31.658987 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6f0d6e32-161e-4cd6-9ee4-5ec15c7f1d9d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Action: 'create', calling method: .version_select at 0x7f050124f550>, body: {"keypair": {"name": "tempest-keypair-976718056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvnMmtVgaDa9DiKMbvThSrc/79KifcYl0zmOzncrN/z1kTQJbS9nqkXXrDMhlGLRFT510erhbv8kn8oggKY0/WT43e9Njq7Cvo/7w2stn0zBSicHoRjCSzy+6O/qGAv+w=="}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:48:31.662320 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-abcb6ed1-f976-4725-ad0a-ed2170b9412a tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:31.664026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-abcb6ed1-f976-4725-ad0a-ed2170b9412a tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:31.670010 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-abcb6ed1-f976-4725-ad0a-ed2170b9412a tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:31.670454 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-abcb6ed1-f976-4725-ad0a-ed2170b9412a tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:31.671488 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-abcb6ed1-f976-4725-ad0a-ed2170b9412a tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:31.672145 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-abcb6ed1-f976-4725-ad0a-ed2170b9412a tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:31.676193 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-6f0d6e32-161e-4cd6-9ee4-5ec15c7f1d9d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Getting quotas for project 47a4ab888dd74218ab5d7812ad095371. Resources: {'key_pairs'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:48:31.680550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-6f0d6e32-161e-4cd6-9ee4-5ec15c7f1d9d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Getting quotas for user 4df05cbf303c4524a665b429f240a17a and project 47a4ab888dd74218ab5d7812ad095371. Resources: {'key_pairs'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:48:31.800585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6f0d6e32-161e-4cd6-9ee4-5ec15c7f1d9d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.145772 Jun 16 19:48:31.801261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 425/818] 10.222.0.36 () {60 vars in 1158 bytes} [Thu Jun 16 19:48:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:31.818219 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-abcb6ed1-f976-4725-ad0a-ed2170b9412a tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:31.826212 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-abcb6ed1-f976-4725-ad0a-ed2170b9412a tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1755 microversion: 2.1 time: 0.167753 Jun 16 19:48:31.826772 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 394/819] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:31 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:32.097405 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0a13db41-1675-464c-abf2-f1c5af83e6f5 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:32.098020 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0a13db41-1675-464c-abf2-f1c5af83e6f5 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:32.104752 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0a13db41-1675-464c-abf2-f1c5af83e6f5 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:32.105219 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0a13db41-1675-464c-abf2-f1c5af83e6f5 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:32.105983 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0a13db41-1675-464c-abf2-f1c5af83e6f5 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:32.106425 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0a13db41-1675-464c-abf2-f1c5af83e6f5 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:32.259228 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0a13db41-1675-464c-abf2-f1c5af83e6f5 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:32.266752 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0a13db41-1675-464c-abf2-f1c5af83e6f5 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1470 microversion: 2.1 time: 0.173357 Jun 16 19:48:32.267339 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 426/820] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:32 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1470 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:32.517973 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c80e6150-2004-4a67-9341-5119d714070f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:32.519957 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c80e6150-2004-4a67-9341-5119d714070f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:32.525523 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c80e6150-2004-4a67-9341-5119d714070f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:32.525975 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c80e6150-2004-4a67-9341-5119d714070f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:32.526748 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c80e6150-2004-4a67-9341-5119d714070f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:32.527205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c80e6150-2004-4a67-9341-5119d714070f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:32.844187 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-eba2efdd-d97b-4000-bdc1-5e8b3d9b0ac8 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:32.844806 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-eba2efdd-d97b-4000-bdc1-5e8b3d9b0ac8 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:32.855932 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eba2efdd-d97b-4000-bdc1-5e8b3d9b0ac8 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:32.856385 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eba2efdd-d97b-4000-bdc1-5e8b3d9b0ac8 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:32.857166 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eba2efdd-d97b-4000-bdc1-5e8b3d9b0ac8 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:32.857609 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eba2efdd-d97b-4000-bdc1-5e8b3d9b0ac8 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:32.864819 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c80e6150-2004-4a67-9341-5119d714070f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:32.873282 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c80e6150-2004-4a67-9341-5119d714070f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1729 microversion: 2.1 time: 0.359206 Jun 16 19:48:32.873862 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 395/821] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:32 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1729 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:32.878666 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-3cceef52-40e1-4006-85de-ba17b42cd161 req-956f6568-4035-441d-9717-65dba5a6530f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1303e37f-ab18-42db-8f6f-dfe6580c7b0f", "name": "network-vif-deleted", "tag": "a195dea2-c192-44c9-a838-68ed16f657df"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:48:32.887011 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-3cceef52-40e1-4006-85de-ba17b42cd161 req-956f6568-4035-441d-9717-65dba5a6530f service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:32.887746 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-3cceef52-40e1-4006-85de-ba17b42cd161 req-956f6568-4035-441d-9717-65dba5a6530f service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:33.008591 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-3cceef52-40e1-4006-85de-ba17b42cd161 req-956f6568-4035-441d-9717-65dba5a6530f service nova] Creating event network-vif-deleted:a195dea2-c192-44c9-a838-68ed16f657df for instance 1303e37f-ab18-42db-8f6f-dfe6580c7b0f on hv-cinder-84617 Jun 16 19:48:33.008591 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-3cceef52-40e1-4006-85de-ba17b42cd161 req-956f6568-4035-441d-9717-65dba5a6530f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117318 Jun 16 19:48:33.008591 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 396/822] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:33.008591 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f80c34d6-5082-43ee-9ca0-268aa3ef21c9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:33.008591 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f80c34d6-5082-43ee-9ca0-268aa3ef21c9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:33.009032 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f80c34d6-5082-43ee-9ca0-268aa3ef21c9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:33.009032 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f80c34d6-5082-43ee-9ca0-268aa3ef21c9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:33.009032 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f80c34d6-5082-43ee-9ca0-268aa3ef21c9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:33.009032 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f80c34d6-5082-43ee-9ca0-268aa3ef21c9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:33.090328 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f80c34d6-5082-43ee-9ca0-268aa3ef21c9 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096220 Jun 16 19:48:33.090937 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 397/823] 10.222.0.36 () {58 vars in 1274 bytes} [Thu Jun 16 19:48:32 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:33.140741 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-eba2efdd-d97b-4000-bdc1-5e8b3d9b0ac8 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:33.149479 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-eba2efdd-d97b-4000-bdc1-5e8b3d9b0ac8 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1755 microversion: 2.1 time: 0.309560 Jun 16 19:48:33.162234 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 427/824] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:32 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1755 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:33.283423 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-10547770-47b5-4f1e-a41b-03ce36044b51 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:33.284035 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-10547770-47b5-4f1e-a41b-03ce36044b51 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:33.290550 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-10547770-47b5-4f1e-a41b-03ce36044b51 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:33.291936 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-10547770-47b5-4f1e-a41b-03ce36044b51 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:33.291936 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-10547770-47b5-4f1e-a41b-03ce36044b51 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:33.292277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-10547770-47b5-4f1e-a41b-03ce36044b51 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:33.383380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-10547770-47b5-4f1e-a41b-03ce36044b51 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:33.391514 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-10547770-47b5-4f1e-a41b-03ce36044b51 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1299 microversion: 2.1 time: 0.111940 Jun 16 19:48:33.392218 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 398/825] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:33 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:34.166569 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-29b73195-2501-403a-9bac-b90f5c3b5cd0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:34.167904 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-29b73195-2501-403a-9bac-b90f5c3b5cd0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:34.175673 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-29b73195-2501-403a-9bac-b90f5c3b5cd0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:34.176333 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-29b73195-2501-403a-9bac-b90f5c3b5cd0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:34.177270 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-29b73195-2501-403a-9bac-b90f5c3b5cd0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:34.178459 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-29b73195-2501-403a-9bac-b90f5c3b5cd0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:34.333717 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-d9e06c2b-1226-4876-bea4-1d9f256855ec req-41cfbc7e-6588-4e89-b67a-75ba3b88f4cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea242cf7-0535-4532-aaa0-59848bf41c73", "tag": "521225d6-b4cf-4644-b00e-7e1640cf92c7"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:48:34.349026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-d9e06c2b-1226-4876-bea4-1d9f256855ec req-41cfbc7e-6588-4e89-b67a-75ba3b88f4cb service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:34.349494 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-d9e06c2b-1226-4876-bea4-1d9f256855ec req-41cfbc7e-6588-4e89-b67a-75ba3b88f4cb service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:34.374205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-d9e06c2b-1226-4876-bea4-1d9f256855ec req-41cfbc7e-6588-4e89-b67a-75ba3b88f4cb service nova] Creating event network-changed:521225d6-b4cf-4644-b00e-7e1640cf92c7 for instance ea242cf7-0535-4532-aaa0-59848bf41c73 on hv-cinder-84617 Jun 16 19:48:34.382445 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-d9e06c2b-1226-4876-bea4-1d9f256855ec req-41cfbc7e-6588-4e89-b67a-75ba3b88f4cb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051591 Jun 16 19:48:34.383295 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 399/826] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:34.409798 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f37dda8d-fb7c-4efe-b548-cdda7cf284e8 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:34.410595 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f37dda8d-fb7c-4efe-b548-cdda7cf284e8 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:34.417394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f37dda8d-fb7c-4efe-b548-cdda7cf284e8 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:34.418107 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f37dda8d-fb7c-4efe-b548-cdda7cf284e8 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:34.418872 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f37dda8d-fb7c-4efe-b548-cdda7cf284e8 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:34.419598 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f37dda8d-fb7c-4efe-b548-cdda7cf284e8 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:34.465563 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f37dda8d-fb7c-4efe-b548-cdda7cf284e8 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:34.465563 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f37dda8d-fb7c-4efe-b548-cdda7cf284e8 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:34.465563 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-f37dda8d-fb7c-4efe-b548-cdda7cf284e8 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lazy-loading 'fault' on Instance uuid 1303e37f-ab18-42db-8f6f-dfe6580c7b0f {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:48:34.530537 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f37dda8d-fb7c-4efe-b548-cdda7cf284e8 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519ddd36b0084a42b18a197b0e5df24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d87fe212654666a76619c9afb14629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:34.540248 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f37dda8d-fb7c-4efe-b548-cdda7cf284e8 tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 200 len: 1304 microversion: 2.1 time: 0.135312 Jun 16 19:48:34.541193 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 400/827] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:34 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:34.588427 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-29b73195-2501-403a-9bac-b90f5c3b5cd0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:34.598955 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-29b73195-2501-403a-9bac-b90f5c3b5cd0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1755 microversion: 2.1 time: 0.437132 Jun 16 19:48:34.599552 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 428/828] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:34 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1755 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:34.869612 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-954568ce-b882-4865-b33e-c40f659e5ef0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-984942294", "imageRef": "9fcb2be6-02db-4853-a8d6-6478a75f26a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "521c8502-275d-4cd0-b45c-aec01d2fbcf4"}], "security_groups": [{"name": "tempest-securitygroup--1759033561"}], "key_name": "tempest-keypair-976718056", "user_data": "}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:48:35.016076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-954568ce-b882-4865-b33e-c40f659e5ef0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] validate_networks() for [('521c8502-275d-4cd0-b45c-aec01d2fbcf4', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:48:35.430648 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-954568ce-b882-4865-b33e-c40f659e5ef0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:48:35.431287 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-954568ce-b882-4865-b33e-c40f659e5ef0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:48:35.431838 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-954568ce-b882-4865-b33e-c40f659e5ef0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:48:35.432245 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-954568ce-b882-4865-b33e-c40f659e5ef0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:48:35.432673 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-954568ce-b882-4865-b33e-c40f659e5ef0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:48:35.442489 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-954568ce-b882-4865-b33e-c40f659e5ef0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:35.443328 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-954568ce-b882-4865-b33e-c40f659e5ef0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:35.444150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-954568ce-b882-4865-b33e-c40f659e5ef0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:35.444574 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-954568ce-b882-4865-b33e-c40f659e5ef0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:35.461638 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-954568ce-b882-4865-b33e-c40f659e5ef0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Getting quotas for project 47a4ab888dd74218ab5d7812ad095371. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:48:35.466114 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-954568ce-b882-4865-b33e-c40f659e5ef0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Getting quotas for user 4df05cbf303c4524a665b429f240a17a and project 47a4ab888dd74218ab5d7812ad095371. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:48:35.487792 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-954568ce-b882-4865-b33e-c40f659e5ef0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:48:35.487792 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-954568ce-b882-4865-b33e-c40f659e5ef0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcb2be6-02db-4853-a8d6-6478a75f26a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:48:35.557992 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bcfe3295-0ff4-4f28-97da-1cf308b9aacc tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:35.558557 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-bcfe3295-0ff4-4f28-97da-1cf308b9aacc tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] [instance: 1303e37f-ab18-42db-8f6f-dfe6580c7b0f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:35.565263 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bcfe3295-0ff4-4f28-97da-1cf308b9aacc tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:35.565734 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bcfe3295-0ff4-4f28-97da-1cf308b9aacc tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:35.566484 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bcfe3295-0ff4-4f28-97da-1cf308b9aacc tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:35.567153 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bcfe3295-0ff4-4f28-97da-1cf308b9aacc tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:35.581042 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-bcfe3295-0ff4-4f28-97da-1cf308b9aacc tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] HTTP exception thrown: Instance 1303e37f-ab18-42db-8f6f-dfe6580c7b0f could not be found. Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bcfe3295-0ff4-4f28-97da-1cf308b9aacc tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Request method failure captured: Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f HTTP/1.1 Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4jUp-dXPi5LpJJYwdblF4bXKASd9j4490PQySA4XbmroDlqPM27yxMWl2iPHia9R_1d9ij6OY_IFPGaw6aUsjt2BK-Sy9HPyuC-3X9x9s-rtnK0owR11yr9gsfjDv3299BjwyztEBFnk3W5AdHwKixlWZg-DQKWuaFuzaZA2pblvMk Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: d2d87fe212654666a76619c9afb14629 Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-VolumesNegativeTest-149078730 Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:48:35.582554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:48:35.584186 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d2d87fe212654666a76619c9afb14629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d2d87fe212654666a76619c9afb14629"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d2d87fe212654666a76619c9afb14629", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d2d87fe212654666a76619c9afb14629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:48:35.584186 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-VolumesNegativeTest-149078730 Jun 16 19:48:35.584186 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: d2d87fe212654666a76619c9afb14629 Jun 16 19:48:35.584186 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-VolumesNegativeTest-149078730 Jun 16 19:48:35.584186 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-VolumesNegativeTest-149078730-project Jun 16 19:48:35.584186 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:48:35.584186 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:48:35.584186 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 519ddd36b0084a42b18a197b0e5df24f Jun 16 19:48:35.584186 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-VolumesNegativeTest-149078730-project Jun 16 19:48:35.584186 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:48:35.584186 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance 1303e37f-ab18-42db-8f6f-dfe6580c7b0f could not be found. Jun 16 19:48:35.584186 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': '1303e37f-ab18-42db-8f6f-dfe6580c7b0f'} Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1303e37f-ab18-42db-8f6f-dfe6580c7b0f could not be found. Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:48:35.585309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:48:35.586798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:48:35.586798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:48:35.586798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:48:35.586798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:48:35.586798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:48:35.586798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:48:35.586798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:48:35.586798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1303e37f-ab18-42db-8f6f-dfe6580c7b0f could not be found. Jun 16 19:48:35.586798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:48:35.586798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:48:35.586798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:48:35.586798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:48:35.586798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:48:35.586798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:48:35.586798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:48:35.586798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:48:35.586798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1303e37f-ab18-42db-8f6f-dfe6580c7b0f could not be found. Jun 16 19:48:35.586798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:48:35.588121 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bcfe3295-0ff4-4f28-97da-1cf308b9aacc tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] Returning 404 to user: Instance 1303e37f-ab18-42db-8f6f-dfe6580c7b0f could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:48:35.588121 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-bcfe3295-0ff4-4f28-97da-1cf308b9aacc tempest-VolumesNegativeTest-149078730 tempest-VolumesNegativeTest-149078730-project] 10.222.0.36 "GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f" status: 404 len: 111 microversion: 2.1 time: 0.030463 Jun 16 19:48:35.588121 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 429/829] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:35 2022] GET /compute/v2.1/servers/1303e37f-ab18-42db-8f6f-dfe6580c7b0f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:48:35.630625 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b75dd8b8-e7c5-46d8-86b7-eb7127f2350a tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:35.631273 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b75dd8b8-e7c5-46d8-86b7-eb7127f2350a tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:35.633096 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:35.637974 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b75dd8b8-e7c5-46d8-86b7-eb7127f2350a tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:35.642503 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b75dd8b8-e7c5-46d8-86b7-eb7127f2350a tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:35.642503 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b75dd8b8-e7c5-46d8-86b7-eb7127f2350a tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:35.642503 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b75dd8b8-e7c5-46d8-86b7-eb7127f2350a tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:35.647205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-954568ce-b882-4865-b33e-c40f659e5ef0 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.783142 Jun 16 19:48:35.648187 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 401/830] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:48:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 19:48:35.658032 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-227b2e4a-d317-447f-bdfd-eb9631beaf6d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:35.658595 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-227b2e4a-d317-447f-bdfd-eb9631beaf6d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:35.734323 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-227b2e4a-d317-447f-bdfd-eb9631beaf6d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:35.743199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-227b2e4a-d317-447f-bdfd-eb9631beaf6d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1240 microversion: 2.1 time: 0.089149 Jun 16 19:48:35.748236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 402/831] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:35 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:35.804451 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b75dd8b8-e7c5-46d8-86b7-eb7127f2350a tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:35.814623 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b75dd8b8-e7c5-46d8-86b7-eb7127f2350a tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1755 microversion: 2.1 time: 0.187668 Jun 16 19:48:35.816059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 430/832] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:35 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:48:36.398183 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-a7d67530-f5d6-4663-b942-2061eb017d2d req-98340f1f-2a57-48c7-b4f8-177b9cd3f689 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea242cf7-0535-4532-aaa0-59848bf41c73", "tag": "521225d6-b4cf-4644-b00e-7e1640cf92c7"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:48:36.407500 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-a7d67530-f5d6-4663-b942-2061eb017d2d req-98340f1f-2a57-48c7-b4f8-177b9cd3f689 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:36.407948 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-a7d67530-f5d6-4663-b942-2061eb017d2d req-98340f1f-2a57-48c7-b4f8-177b9cd3f689 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:36.418014 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-a7d67530-f5d6-4663-b942-2061eb017d2d req-98340f1f-2a57-48c7-b4f8-177b9cd3f689 service nova] Creating event network-changed:521225d6-b4cf-4644-b00e-7e1640cf92c7 for instance ea242cf7-0535-4532-aaa0-59848bf41c73 on hv-cinder-84617 Jun 16 19:48:36.426848 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-a7d67530-f5d6-4663-b942-2061eb017d2d req-98340f1f-2a57-48c7-b4f8-177b9cd3f689 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032964 Jun 16 19:48:36.427668 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 403/833] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:36.764588 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7ceab8b1-0d6a-42d4-9690-938b77d21513 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:36.765203 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-7ceab8b1-0d6a-42d4-9690-938b77d21513 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:36.833035 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ba46808e-0768-43f1-9dc0-a39a82853b79 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:36.833751 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ba46808e-0768-43f1-9dc0-a39a82853b79 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:36.839541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-7ceab8b1-0d6a-42d4-9690-938b77d21513 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:36.840908 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ba46808e-0768-43f1-9dc0-a39a82853b79 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:36.841518 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ba46808e-0768-43f1-9dc0-a39a82853b79 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:36.842467 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ba46808e-0768-43f1-9dc0-a39a82853b79 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:36.843256 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ba46808e-0768-43f1-9dc0-a39a82853b79 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:36.846558 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-7ceab8b1-0d6a-42d4-9690-938b77d21513 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1240 microversion: 2.1 time: 0.086179 Jun 16 19:48:36.847161 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 431/834] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:36 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:37.000854 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ba46808e-0768-43f1-9dc0-a39a82853b79 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:37.017682 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ba46808e-0768-43f1-9dc0-a39a82853b79 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1755 microversion: 2.1 time: 0.188771 Jun 16 19:48:37.018267 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 404/835] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:36 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:37.863344 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0d025b1a-0701-4100-9353-3ad821c5de93 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:37.863957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0d025b1a-0701-4100-9353-3ad821c5de93 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:37.870661 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0d025b1a-0701-4100-9353-3ad821c5de93 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:37.871133 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0d025b1a-0701-4100-9353-3ad821c5de93 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:37.871886 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0d025b1a-0701-4100-9353-3ad821c5de93 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:37.872317 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0d025b1a-0701-4100-9353-3ad821c5de93 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:37.931507 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0d025b1a-0701-4100-9353-3ad821c5de93 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:37.938847 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0d025b1a-0701-4100-9353-3ad821c5de93 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1236 microversion: 2.1 time: 0.079367 Jun 16 19:48:37.944214 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 432/836] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:37 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1236 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:38.034790 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-09095f0a-1561-4fe7-a0bb-c70e2ad89125 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:38.035503 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-09095f0a-1561-4fe7-a0bb-c70e2ad89125 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:38.042041 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-09095f0a-1561-4fe7-a0bb-c70e2ad89125 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:38.042650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-09095f0a-1561-4fe7-a0bb-c70e2ad89125 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:38.043444 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-09095f0a-1561-4fe7-a0bb-c70e2ad89125 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:38.043885 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-09095f0a-1561-4fe7-a0bb-c70e2ad89125 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:38.192543 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-09095f0a-1561-4fe7-a0bb-c70e2ad89125 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:38.201781 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-09095f0a-1561-4fe7-a0bb-c70e2ad89125 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1755 microversion: 2.1 time: 0.170810 Jun 16 19:48:38.202280 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 405/837] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:38 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:38.956872 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-29fe9dca-def8-4c0a-b286-49daa65fa730 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:38.957498 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-29fe9dca-def8-4c0a-b286-49daa65fa730 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:38.964399 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-29fe9dca-def8-4c0a-b286-49daa65fa730 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:38.964860 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-29fe9dca-def8-4c0a-b286-49daa65fa730 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:38.965628 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-29fe9dca-def8-4c0a-b286-49daa65fa730 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:38.966072 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-29fe9dca-def8-4c0a-b286-49daa65fa730 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:39.031032 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-29fe9dca-def8-4c0a-b286-49daa65fa730 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:39.039184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-29fe9dca-def8-4c0a-b286-49daa65fa730 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1236 microversion: 2.1 time: 0.086080 Jun 16 19:48:39.039739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 433/838] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:38 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1236 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:39.218272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-616c5c74-9f54-4bb4-9e2a-a6da7321ac17 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:39.218949 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-616c5c74-9f54-4bb4-9e2a-a6da7321ac17 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:39.225426 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-616c5c74-9f54-4bb4-9e2a-a6da7321ac17 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:39.225879 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-616c5c74-9f54-4bb4-9e2a-a6da7321ac17 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:39.226636 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-616c5c74-9f54-4bb4-9e2a-a6da7321ac17 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:39.227109 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-616c5c74-9f54-4bb4-9e2a-a6da7321ac17 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:39.365436 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-616c5c74-9f54-4bb4-9e2a-a6da7321ac17 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:39.373323 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-616c5c74-9f54-4bb4-9e2a-a6da7321ac17 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1755 microversion: 2.1 time: 0.158859 Jun 16 19:48:39.373881 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 406/839] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:39 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:40.058903 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-596a9e0e-39f4-43f9-9746-2cf47f0bee0f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:40.059716 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-596a9e0e-39f4-43f9-9746-2cf47f0bee0f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:40.066939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-596a9e0e-39f4-43f9-9746-2cf47f0bee0f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:40.067404 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-596a9e0e-39f4-43f9-9746-2cf47f0bee0f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:40.069225 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-596a9e0e-39f4-43f9-9746-2cf47f0bee0f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:40.069976 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-596a9e0e-39f4-43f9-9746-2cf47f0bee0f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:40.133466 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-596a9e0e-39f4-43f9-9746-2cf47f0bee0f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:40.142214 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-596a9e0e-39f4-43f9-9746-2cf47f0bee0f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1236 microversion: 2.1 time: 0.086701 Jun 16 19:48:40.142800 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 434/840] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:40 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1236 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:40.391384 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9c920a70-ea16-4632-a8a5-5518a9d54878 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:40.392043 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9c920a70-ea16-4632-a8a5-5518a9d54878 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:40.394853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:40.401749 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9c920a70-ea16-4632-a8a5-5518a9d54878 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:40.402201 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9c920a70-ea16-4632-a8a5-5518a9d54878 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:40.403009 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9c920a70-ea16-4632-a8a5-5518a9d54878 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:40.403440 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9c920a70-ea16-4632-a8a5-5518a9d54878 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:40.571833 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9c920a70-ea16-4632-a8a5-5518a9d54878 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:40.587402 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9c920a70-ea16-4632-a8a5-5518a9d54878 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1755 microversion: 2.1 time: 0.200668 Jun 16 19:48:40.588100 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 407/841] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:40 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1755 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:41.160651 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e1a29bad-f2f2-4b27-881d-281a4ecc2fba tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:41.161265 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e1a29bad-f2f2-4b27-881d-281a4ecc2fba tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:41.169052 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e1a29bad-f2f2-4b27-881d-281a4ecc2fba tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:41.169052 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e1a29bad-f2f2-4b27-881d-281a4ecc2fba tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:41.169947 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e1a29bad-f2f2-4b27-881d-281a4ecc2fba tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:41.170380 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e1a29bad-f2f2-4b27-881d-281a4ecc2fba tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:41.282859 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e1a29bad-f2f2-4b27-881d-281a4ecc2fba tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:41.291685 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e1a29bad-f2f2-4b27-881d-281a4ecc2fba tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1300 microversion: 2.1 time: 0.134950 Jun 16 19:48:41.292383 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 435/842] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:41 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1300 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:41.604172 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-37e66e30-4734-4c3f-8f53-f98e71080ce1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:41.604756 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-37e66e30-4734-4c3f-8f53-f98e71080ce1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:41.611599 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-37e66e30-4734-4c3f-8f53-f98e71080ce1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:41.612042 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-37e66e30-4734-4c3f-8f53-f98e71080ce1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:41.612789 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-37e66e30-4734-4c3f-8f53-f98e71080ce1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:41.613218 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-37e66e30-4734-4c3f-8f53-f98e71080ce1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:41.763877 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-37e66e30-4734-4c3f-8f53-f98e71080ce1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:41.772458 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-37e66e30-4734-4c3f-8f53-f98e71080ce1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1755 microversion: 2.1 time: 0.172117 Jun 16 19:48:41.773035 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 408/843] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:41 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:42.309991 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-21f9e97d-10d5-4552-aaa5-9df83a917eaf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:42.311059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-21f9e97d-10d5-4552-aaa5-9df83a917eaf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:42.318698 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-21f9e97d-10d5-4552-aaa5-9df83a917eaf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:42.319183 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-21f9e97d-10d5-4552-aaa5-9df83a917eaf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:42.319955 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-21f9e97d-10d5-4552-aaa5-9df83a917eaf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:42.321036 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-21f9e97d-10d5-4552-aaa5-9df83a917eaf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:42.453771 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-21f9e97d-10d5-4552-aaa5-9df83a917eaf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:42.461644 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-21f9e97d-10d5-4552-aaa5-9df83a917eaf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1366 microversion: 2.1 time: 0.155788 Jun 16 19:48:42.462201 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 436/844] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:42 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:42.790037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7cce94eb-01c9-4fe1-b360-a15065bf20f3 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:42.790759 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7cce94eb-01c9-4fe1-b360-a15065bf20f3 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:42.797733 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7cce94eb-01c9-4fe1-b360-a15065bf20f3 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:42.798175 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7cce94eb-01c9-4fe1-b360-a15065bf20f3 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:42.798945 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7cce94eb-01c9-4fe1-b360-a15065bf20f3 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:42.799393 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7cce94eb-01c9-4fe1-b360-a15065bf20f3 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:42.803260 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:42.971538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7cce94eb-01c9-4fe1-b360-a15065bf20f3 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:42.979462 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7cce94eb-01c9-4fe1-b360-a15065bf20f3 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1755 microversion: 2.1 time: 0.193867 Jun 16 19:48:42.980104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 409/845] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:42 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:43.478614 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d17672b0-3e6f-46b0-9f7c-c98f5f409b1d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:43.479784 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d17672b0-3e6f-46b0-9f7c-c98f5f409b1d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:43.485818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d17672b0-3e6f-46b0-9f7c-c98f5f409b1d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:43.486273 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d17672b0-3e6f-46b0-9f7c-c98f5f409b1d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:43.487749 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d17672b0-3e6f-46b0-9f7c-c98f5f409b1d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:43.487749 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d17672b0-3e6f-46b0-9f7c-c98f5f409b1d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:43.623836 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d17672b0-3e6f-46b0-9f7c-c98f5f409b1d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:43.631818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d17672b0-3e6f-46b0-9f7c-c98f5f409b1d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1366 microversion: 2.1 time: 0.157186 Jun 16 19:48:43.632501 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 437/846] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:43 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:43.998685 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cedbe2c7-5f97-4b73-9e95-d5e468ac629e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:43.998685 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-cedbe2c7-5f97-4b73-9e95-d5e468ac629e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:44.003686 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cedbe2c7-5f97-4b73-9e95-d5e468ac629e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:44.004200 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cedbe2c7-5f97-4b73-9e95-d5e468ac629e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:44.005031 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cedbe2c7-5f97-4b73-9e95-d5e468ac629e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:44.005530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cedbe2c7-5f97-4b73-9e95-d5e468ac629e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:44.148775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cedbe2c7-5f97-4b73-9e95-d5e468ac629e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:44.156861 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cedbe2c7-5f97-4b73-9e95-d5e468ac629e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1755 microversion: 2.1 time: 0.164281 Jun 16 19:48:44.157459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 410/847] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:43 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:44.649555 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-342b0ffd-d255-4edd-acec-90cbd519664b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:44.650128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-342b0ffd-d255-4edd-acec-90cbd519664b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:44.657167 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-342b0ffd-d255-4edd-acec-90cbd519664b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:44.657621 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-342b0ffd-d255-4edd-acec-90cbd519664b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:44.658386 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-342b0ffd-d255-4edd-acec-90cbd519664b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:44.658841 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-342b0ffd-d255-4edd-acec-90cbd519664b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:44.856445 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-342b0ffd-d255-4edd-acec-90cbd519664b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:44.864583 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-342b0ffd-d255-4edd-acec-90cbd519664b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1366 microversion: 2.1 time: 0.219647 Jun 16 19:48:44.873084 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 438/848] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:44 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:45.173974 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e5675fdf-a05e-4366-908f-a524ba3f0025 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:45.175281 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e5675fdf-a05e-4366-908f-a524ba3f0025 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:45.191629 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e5675fdf-a05e-4366-908f-a524ba3f0025 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:45.192365 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e5675fdf-a05e-4366-908f-a524ba3f0025 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:45.194325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e5675fdf-a05e-4366-908f-a524ba3f0025 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:45.195685 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e5675fdf-a05e-4366-908f-a524ba3f0025 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:45.360440 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e5675fdf-a05e-4366-908f-a524ba3f0025 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:45.369260 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e5675fdf-a05e-4366-908f-a524ba3f0025 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1755 microversion: 2.1 time: 0.199334 Jun 16 19:48:45.369819 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 411/849] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:45 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1755 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:45.708203 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-53c83693-605f-4fda-85b2-3c9056674e0f req-315644df-5172-4a11-a6d8-6607092ab1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5581fbe-6950-4ade-86e0-a1fa41b436ca", "tag": "d9b6745f-75a1-4699-a761-dbf5ba2f0465"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:48:45.727368 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-53c83693-605f-4fda-85b2-3c9056674e0f req-315644df-5172-4a11-a6d8-6607092ab1a4 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:45.727838 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-53c83693-605f-4fda-85b2-3c9056674e0f req-315644df-5172-4a11-a6d8-6607092ab1a4 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:45.740762 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-53c83693-605f-4fda-85b2-3c9056674e0f req-315644df-5172-4a11-a6d8-6607092ab1a4 service nova] Creating event network-changed:d9b6745f-75a1-4699-a761-dbf5ba2f0465 for instance b5581fbe-6950-4ade-86e0-a1fa41b436ca on hv-cinder-84617 Jun 16 19:48:45.746036 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-53c83693-605f-4fda-85b2-3c9056674e0f req-315644df-5172-4a11-a6d8-6607092ab1a4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042702 Jun 16 19:48:45.746592 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 439/850] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:45.882340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6c297e51-02b5-413a-92fe-cd80c72a8d83 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:45.882979 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6c297e51-02b5-413a-92fe-cd80c72a8d83 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:45.884769 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:45.885491 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=8 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:45.890209 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6c297e51-02b5-413a-92fe-cd80c72a8d83 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:45.890653 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6c297e51-02b5-413a-92fe-cd80c72a8d83 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:45.891453 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6c297e51-02b5-413a-92fe-cd80c72a8d83 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:45.892039 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6c297e51-02b5-413a-92fe-cd80c72a8d83 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:46.022612 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6c297e51-02b5-413a-92fe-cd80c72a8d83 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:46.030904 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6c297e51-02b5-413a-92fe-cd80c72a8d83 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1366 microversion: 2.1 time: 0.152946 Jun 16 19:48:46.031483 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 412/851] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:45 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:46.387843 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-99451ad2-b128-40e2-b44d-5b1f0d883d3e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:46.388546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-99451ad2-b128-40e2-b44d-5b1f0d883d3e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:46.395049 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-99451ad2-b128-40e2-b44d-5b1f0d883d3e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:46.395499 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-99451ad2-b128-40e2-b44d-5b1f0d883d3e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:46.396263 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-99451ad2-b128-40e2-b44d-5b1f0d883d3e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:46.396698 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-99451ad2-b128-40e2-b44d-5b1f0d883d3e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:46.623590 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-99451ad2-b128-40e2-b44d-5b1f0d883d3e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:46.630336 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-99451ad2-b128-40e2-b44d-5b1f0d883d3e tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1758 microversion: 2.1 time: 0.246550 Jun 16 19:48:46.631427 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 440/852] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:46 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1758 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:47.213486 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fa5a5726-7456-417d-9d14-aeaea3850703 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:47.214096 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fa5a5726-7456-417d-9d14-aeaea3850703 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:47.220109 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa5a5726-7456-417d-9d14-aeaea3850703 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:47.220549 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa5a5726-7456-417d-9d14-aeaea3850703 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:47.221291 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa5a5726-7456-417d-9d14-aeaea3850703 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:47.221716 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa5a5726-7456-417d-9d14-aeaea3850703 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:47.348200 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fa5a5726-7456-417d-9d14-aeaea3850703 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:47.356347 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fa5a5726-7456-417d-9d14-aeaea3850703 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1366 microversion: 2.1 time: 0.311121 Jun 16 19:48:47.356904 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 413/853] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:47 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:48.372287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-ae0ce707-9d0f-4334-aaac-f7a376157696 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:48.372899 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-ae0ce707-9d0f-4334-aaac-f7a376157696 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:48.375304 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=6 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:48.382572 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ae0ce707-9d0f-4334-aaac-f7a376157696 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:48.382572 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ae0ce707-9d0f-4334-aaac-f7a376157696 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:48.382572 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ae0ce707-9d0f-4334-aaac-f7a376157696 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:48.382572 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ae0ce707-9d0f-4334-aaac-f7a376157696 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:48.510863 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ae0ce707-9d0f-4334-aaac-f7a376157696 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:48.518341 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-ae0ce707-9d0f-4334-aaac-f7a376157696 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1366 microversion: 2.1 time: 0.149909 Jun 16 19:48:48.518899 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 441/854] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:48 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:49.535078 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-643e5c61-1b4a-4cad-ac44-816a61b3addc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:49.535690 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-643e5c61-1b4a-4cad-ac44-816a61b3addc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:49.541956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-643e5c61-1b4a-4cad-ac44-816a61b3addc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:49.542400 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-643e5c61-1b4a-4cad-ac44-816a61b3addc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:49.543187 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-643e5c61-1b4a-4cad-ac44-816a61b3addc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:49.543616 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-643e5c61-1b4a-4cad-ac44-816a61b3addc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:49.683834 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-643e5c61-1b4a-4cad-ac44-816a61b3addc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:49.691190 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-643e5c61-1b4a-4cad-ac44-816a61b3addc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1366 microversion: 2.1 time: 0.159968 Jun 16 19:48:49.691804 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 414/855] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:49 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:50.710186 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9b7b7892-e399-4d02-b8c3-041951beb4b7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:50.710795 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9b7b7892-e399-4d02-b8c3-041951beb4b7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:50.716954 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9b7b7892-e399-4d02-b8c3-041951beb4b7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:50.717397 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9b7b7892-e399-4d02-b8c3-041951beb4b7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:50.718149 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9b7b7892-e399-4d02-b8c3-041951beb4b7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:50.718574 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9b7b7892-e399-4d02-b8c3-041951beb4b7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:50.844796 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9b7b7892-e399-4d02-b8c3-041951beb4b7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:50.852446 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9b7b7892-e399-4d02-b8c3-041951beb4b7 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1366 microversion: 2.1 time: 0.147245 Jun 16 19:48:50.853564 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 442/856] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:50 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:51.045775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8d8ff691-c662-4f2e-a2ad-c2c3686c4815 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:51.046260 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8d8ff691-c662-4f2e-a2ad-c2c3686c4815 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:51.053092 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8d8ff691-c662-4f2e-a2ad-c2c3686c4815 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:51.053536 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8d8ff691-c662-4f2e-a2ad-c2c3686c4815 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:51.054288 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8d8ff691-c662-4f2e-a2ad-c2c3686c4815 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:51.054712 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8d8ff691-c662-4f2e-a2ad-c2c3686c4815 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:51.133640 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-8d8ff691-c662-4f2e-a2ad-c2c3686c4815 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lazy-loading 'services' on Instance uuid 8e487bec-d93f-4777-a2df-96eab8459319 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:48:51.296584 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:48:51.297689 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Thu Jun 16 19:48:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:48:51.431591 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8d8ff691-c662-4f2e-a2ad-c2c3686c4815 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319/os-volume_attachments/ee689f9f-8c58-40db-b418-50c68d8d2ec2" status: 202 len: 0 microversion: 2.1 time: 0.389320 Jun 16 19:48:51.432088 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 415/857] 10.222.0.36 () {58 vars in 1415 bytes} [Thu Jun 16 19:48:51 2022] DELETE /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319/os-volume_attachments/ee689f9f-8c58-40db-b418-50c68d8d2ec2 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:48:51.869548 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b3d48611-02ac-43d3-b081-3f11dd69d216 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:51.870169 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b3d48611-02ac-43d3-b081-3f11dd69d216 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:51.876643 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b3d48611-02ac-43d3-b081-3f11dd69d216 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:51.877095 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b3d48611-02ac-43d3-b081-3f11dd69d216 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:51.877852 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b3d48611-02ac-43d3-b081-3f11dd69d216 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:51.878297 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b3d48611-02ac-43d3-b081-3f11dd69d216 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:52.003447 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b3d48611-02ac-43d3-b081-3f11dd69d216 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:52.007690 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:48:52.011845 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b3d48611-02ac-43d3-b081-3f11dd69d216 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1366 microversion: 2.1 time: 0.146174 Jun 16 19:48:52.012404 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 443/858] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:51 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:53.030532 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-eab9e40f-5165-4b00-ae10-e00c4315dd96 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:53.031260 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-eab9e40f-5165-4b00-ae10-e00c4315dd96 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:53.037960 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eab9e40f-5165-4b00-ae10-e00c4315dd96 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:53.038402 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eab9e40f-5165-4b00-ae10-e00c4315dd96 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:53.039193 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eab9e40f-5165-4b00-ae10-e00c4315dd96 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:53.039629 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eab9e40f-5165-4b00-ae10-e00c4315dd96 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:53.164817 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-eab9e40f-5165-4b00-ae10-e00c4315dd96 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:53.172224 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-eab9e40f-5165-4b00-ae10-e00c4315dd96 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1366 microversion: 2.1 time: 0.146334 Jun 16 19:48:53.172777 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 416/859] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:53 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:54.189325 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c86f4f60-2a1f-49e2-b193-5d2e0761ab8a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:54.190044 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c86f4f60-2a1f-49e2-b193-5d2e0761ab8a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:54.197118 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c86f4f60-2a1f-49e2-b193-5d2e0761ab8a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:54.197561 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c86f4f60-2a1f-49e2-b193-5d2e0761ab8a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:54.198307 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c86f4f60-2a1f-49e2-b193-5d2e0761ab8a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:54.198737 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c86f4f60-2a1f-49e2-b193-5d2e0761ab8a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:54.327314 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c86f4f60-2a1f-49e2-b193-5d2e0761ab8a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:54.336925 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c86f4f60-2a1f-49e2-b193-5d2e0761ab8a tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1366 microversion: 2.1 time: 0.151801 Jun 16 19:48:54.337490 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 444/860] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:54 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:55.353748 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e59b5f7f-ff9f-43c2-ab79-148896f09803 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:55.354413 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e59b5f7f-ff9f-43c2-ab79-148896f09803 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:55.360390 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e59b5f7f-ff9f-43c2-ab79-148896f09803 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:55.360841 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e59b5f7f-ff9f-43c2-ab79-148896f09803 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:55.361601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e59b5f7f-ff9f-43c2-ab79-148896f09803 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:55.362029 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e59b5f7f-ff9f-43c2-ab79-148896f09803 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:55.494791 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e59b5f7f-ff9f-43c2-ab79-148896f09803 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:55.502079 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e59b5f7f-ff9f-43c2-ab79-148896f09803 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1366 microversion: 2.1 time: 0.152380 Jun 16 19:48:55.502648 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 417/861] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:55 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:55.698912 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-71d576e8-419e-476c-b5a6-03a3b6bca0e4 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:55.698912 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-71d576e8-419e-476c-b5a6-03a3b6bca0e4 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:55.705942 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-71d576e8-419e-476c-b5a6-03a3b6bca0e4 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:55.706381 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-71d576e8-419e-476c-b5a6-03a3b6bca0e4 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:55.707308 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-71d576e8-419e-476c-b5a6-03a3b6bca0e4 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:55.708677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-71d576e8-419e-476c-b5a6-03a3b6bca0e4 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:55.738999 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-71d576e8-419e-476c-b5a6-03a3b6bca0e4 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Going to try to terminate instance {{(pid=124551) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:48:56.077842 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-71d576e8-419e-476c-b5a6-03a3b6bca0e4 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 204 len: 0 microversion: 2.1 time: 0.386035 Jun 16 19:48:56.078406 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 445/862] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:48:55 2022] DELETE /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:48:56.087193 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3480f8d0-71d2-4c1b-ae66-420c89991e88 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:56.087764 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3480f8d0-71d2-4c1b-ae66-420c89991e88 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:56.093690 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3480f8d0-71d2-4c1b-ae66-420c89991e88 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:56.094141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3480f8d0-71d2-4c1b-ae66-420c89991e88 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:56.094897 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3480f8d0-71d2-4c1b-ae66-420c89991e88 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:56.095359 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3480f8d0-71d2-4c1b-ae66-420c89991e88 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:56.222017 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3480f8d0-71d2-4c1b-ae66-420c89991e88 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:56.230192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3480f8d0-71d2-4c1b-ae66-420c89991e88 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1514 microversion: 2.1 time: 0.147535 Jun 16 19:48:56.230749 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 418/863] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:56 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:56.519975 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e5d221d2-8887-43dd-adf9-677ead41699e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:56.523004 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e5d221d2-8887-43dd-adf9-677ead41699e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:56.527355 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e5d221d2-8887-43dd-adf9-677ead41699e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:56.527805 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e5d221d2-8887-43dd-adf9-677ead41699e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:56.528568 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e5d221d2-8887-43dd-adf9-677ead41699e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:56.529004 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e5d221d2-8887-43dd-adf9-677ead41699e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:56.658484 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e5d221d2-8887-43dd-adf9-677ead41699e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:56.665845 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e5d221d2-8887-43dd-adf9-677ead41699e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1366 microversion: 2.1 time: 0.150112 Jun 16 19:48:56.666391 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 446/864] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:56 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:57.247192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-92d0a757-4248-4e7c-9d1a-18af225fb230 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:57.247891 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-92d0a757-4248-4e7c-9d1a-18af225fb230 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:57.254356 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92d0a757-4248-4e7c-9d1a-18af225fb230 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:57.260612 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92d0a757-4248-4e7c-9d1a-18af225fb230 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:57.260612 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92d0a757-4248-4e7c-9d1a-18af225fb230 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:57.260612 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92d0a757-4248-4e7c-9d1a-18af225fb230 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:57.390369 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-92d0a757-4248-4e7c-9d1a-18af225fb230 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:57.397991 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-92d0a757-4248-4e7c-9d1a-18af225fb230 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1514 microversion: 2.1 time: 0.154638 Jun 16 19:48:57.398639 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 419/865] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:57 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:57.420542 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-1a1180ec-4b4c-40b1-8453-564f337b39af req-e7bcc5e6-98e1-4a93-9d48-caed929a863e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5581fbe-6950-4ade-86e0-a1fa41b436ca", "name": "network-vif-plugged", "status": "completed", "tag": "d9b6745f-75a1-4699-a761-dbf5ba2f0465"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:48:57.429657 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-1a1180ec-4b4c-40b1-8453-564f337b39af req-e7bcc5e6-98e1-4a93-9d48-caed929a863e service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:57.430103 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-1a1180ec-4b4c-40b1-8453-564f337b39af req-e7bcc5e6-98e1-4a93-9d48-caed929a863e service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:57.443231 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-1a1180ec-4b4c-40b1-8453-564f337b39af req-e7bcc5e6-98e1-4a93-9d48-caed929a863e service nova] Creating event network-vif-plugged:d9b6745f-75a1-4699-a761-dbf5ba2f0465 for instance b5581fbe-6950-4ade-86e0-a1fa41b436ca on hv-cinder-84617 Jun 16 19:48:57.448127 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-1a1180ec-4b4c-40b1-8453-564f337b39af req-e7bcc5e6-98e1-4a93-9d48-caed929a863e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031331 Jun 16 19:48:57.448771 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 447/866] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:48:57.682497 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9d2c319c-b30d-46a7-9741-cb8ffd794eab tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:57.683070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9d2c319c-b30d-46a7-9741-cb8ffd794eab tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:57.688981 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d2c319c-b30d-46a7-9741-cb8ffd794eab tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:57.689440 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d2c319c-b30d-46a7-9741-cb8ffd794eab tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:57.690173 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d2c319c-b30d-46a7-9741-cb8ffd794eab tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:57.690604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d2c319c-b30d-46a7-9741-cb8ffd794eab tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:57.829750 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9d2c319c-b30d-46a7-9741-cb8ffd794eab tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:57.837646 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9d2c319c-b30d-46a7-9741-cb8ffd794eab tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1366 microversion: 2.1 time: 0.159065 Jun 16 19:48:57.852703 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 420/867] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:57 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:58.415496 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-179e7622-7aaa-4616-a970-ee6f84fc59f5 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:58.416216 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-179e7622-7aaa-4616-a970-ee6f84fc59f5 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:58.422589 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-179e7622-7aaa-4616-a970-ee6f84fc59f5 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:58.423183 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-179e7622-7aaa-4616-a970-ee6f84fc59f5 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:58.423764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-179e7622-7aaa-4616-a970-ee6f84fc59f5 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:58.424223 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-179e7622-7aaa-4616-a970-ee6f84fc59f5 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:58.553784 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-179e7622-7aaa-4616-a970-ee6f84fc59f5 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:58.561305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-179e7622-7aaa-4616-a970-ee6f84fc59f5 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1514 microversion: 2.1 time: 0.150069 Jun 16 19:48:58.561852 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 448/868] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:58 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:58.854716 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-13d56fb9-a287-4b49-85ea-e74ae328a668 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:58.855358 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-13d56fb9-a287-4b49-85ea-e74ae328a668 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:58.861770 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-13d56fb9-a287-4b49-85ea-e74ae328a668 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:58.862213 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-13d56fb9-a287-4b49-85ea-e74ae328a668 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:58.863000 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-13d56fb9-a287-4b49-85ea-e74ae328a668 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:58.863433 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-13d56fb9-a287-4b49-85ea-e74ae328a668 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:58.996311 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-13d56fb9-a287-4b49-85ea-e74ae328a668 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:59.003715 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-13d56fb9-a287-4b49-85ea-e74ae328a668 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1366 microversion: 2.1 time: 0.152848 Jun 16 19:48:59.004284 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 421/869] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:58 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:48:59.578663 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-220a49ac-db08-4efe-b741-e4e1d58d7967 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:48:59.579297 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-220a49ac-db08-4efe-b741-e4e1d58d7967 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:48:59.586425 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-220a49ac-db08-4efe-b741-e4e1d58d7967 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:59.586867 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-220a49ac-db08-4efe-b741-e4e1d58d7967 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:59.587651 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-220a49ac-db08-4efe-b741-e4e1d58d7967 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:48:59.588077 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-220a49ac-db08-4efe-b741-e4e1d58d7967 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:48:59.717743 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-220a49ac-db08-4efe-b741-e4e1d58d7967 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:48:59.725437 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-220a49ac-db08-4efe-b741-e4e1d58d7967 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1514 microversion: 2.1 time: 0.150708 Jun 16 19:48:59.726013 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 449/870] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:48:59 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:00.020952 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-70565314-ecfe-41cc-9527-253f56741da9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:00.021559 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-70565314-ecfe-41cc-9527-253f56741da9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:00.027680 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-70565314-ecfe-41cc-9527-253f56741da9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:00.028124 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-70565314-ecfe-41cc-9527-253f56741da9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:00.028885 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-70565314-ecfe-41cc-9527-253f56741da9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:00.031047 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-70565314-ecfe-41cc-9527-253f56741da9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:00.108602 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-3855f8cb-9a0b-45a4-8d18-5a9d4075d6ff req-49e1362a-e621-4042-8cf5-54f069009cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e487bec-d93f-4777-a2df-96eab8459319", "name": "network-vif-deleted", "tag": "0d5544ee-f9fd-469d-8be9-aae37bba47b9"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:00.118233 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-3855f8cb-9a0b-45a4-8d18-5a9d4075d6ff req-49e1362a-e621-4042-8cf5-54f069009cf1 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:00.118781 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-3855f8cb-9a0b-45a4-8d18-5a9d4075d6ff req-49e1362a-e621-4042-8cf5-54f069009cf1 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:00.131556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-3855f8cb-9a0b-45a4-8d18-5a9d4075d6ff req-49e1362a-e621-4042-8cf5-54f069009cf1 service nova] Creating event network-vif-deleted:0d5544ee-f9fd-469d-8be9-aae37bba47b9 for instance 8e487bec-d93f-4777-a2df-96eab8459319 on hv-cinder-84617 Jun 16 19:49:00.136468 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-3855f8cb-9a0b-45a4-8d18-5a9d4075d6ff req-49e1362a-e621-4042-8cf5-54f069009cf1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031686 Jun 16 19:49:00.137240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 450/871] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:49:00.195477 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-70565314-ecfe-41cc-9527-253f56741da9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:00.203679 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-70565314-ecfe-41cc-9527-253f56741da9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1366 microversion: 2.1 time: 0.186378 Jun 16 19:49:00.204439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 422/872] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:00 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:49:00.743462 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-16c5485c-b88a-4a3d-885a-3ca95b43b1e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:00.744173 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-16c5485c-b88a-4a3d-885a-3ca95b43b1e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:00.750645 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-16c5485c-b88a-4a3d-885a-3ca95b43b1e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:00.751152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-16c5485c-b88a-4a3d-885a-3ca95b43b1e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:00.751922 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-16c5485c-b88a-4a3d-885a-3ca95b43b1e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:00.752381 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-16c5485c-b88a-4a3d-885a-3ca95b43b1e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:00.782897 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-16c5485c-b88a-4a3d-885a-3ca95b43b1e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:00.783378 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-16c5485c-b88a-4a3d-885a-3ca95b43b1e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:00.783851 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-16c5485c-b88a-4a3d-885a-3ca95b43b1e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lazy-loading 'fault' on Instance uuid 8e487bec-d93f-4777-a2df-96eab8459319 {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:49:00.826388 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-16c5485c-b88a-4a3d-885a-3ca95b43b1e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:00.833865 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-16c5485c-b88a-4a3d-885a-3ca95b43b1e3 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1309 microversion: 2.1 time: 0.095620 Jun 16 19:49:00.834410 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 451/873] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:00 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:01.220686 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d53296fe-93b2-40a8-8a7e-284907527d30 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:01.221286 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d53296fe-93b2-40a8-8a7e-284907527d30 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:01.227945 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d53296fe-93b2-40a8-8a7e-284907527d30 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:01.228391 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d53296fe-93b2-40a8-8a7e-284907527d30 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:01.230177 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d53296fe-93b2-40a8-8a7e-284907527d30 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:01.230177 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d53296fe-93b2-40a8-8a7e-284907527d30 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:01.367685 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d53296fe-93b2-40a8-8a7e-284907527d30 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:01.367871 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d53296fe-93b2-40a8-8a7e-284907527d30 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1366 microversion: 2.1 time: 0.150886 Jun 16 19:49:01.368276 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 423/874] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:01 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:01.851439 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-87217230-6550-423f-bcdc-953a3434ac67 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:01.852017 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-87217230-6550-423f-bcdc-953a3434ac67 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:01.858306 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-87217230-6550-423f-bcdc-953a3434ac67 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:01.858750 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-87217230-6550-423f-bcdc-953a3434ac67 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:01.859566 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-87217230-6550-423f-bcdc-953a3434ac67 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:01.860063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-87217230-6550-423f-bcdc-953a3434ac67 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:01.891141 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-87217230-6550-423f-bcdc-953a3434ac67 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:01.891657 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-87217230-6550-423f-bcdc-953a3434ac67 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:01.892110 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-87217230-6550-423f-bcdc-953a3434ac67 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lazy-loading 'fault' on Instance uuid 8e487bec-d93f-4777-a2df-96eab8459319 {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:49:01.931949 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-87217230-6550-423f-bcdc-953a3434ac67 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7fd310fe0254401b10f6b1517994233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da06c03197114259aac4bf5444485d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:01.939383 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-87217230-6550-423f-bcdc-953a3434ac67 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 200 len: 1309 microversion: 2.1 time: 0.092381 Jun 16 19:49:01.939948 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 452/875] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:01 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:49:02.384814 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0c32c3c0-6e52-48b5-8350-52dd6326d94e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:02.385359 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0c32c3c0-6e52-48b5-8350-52dd6326d94e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:02.391684 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0c32c3c0-6e52-48b5-8350-52dd6326d94e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:02.392130 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0c32c3c0-6e52-48b5-8350-52dd6326d94e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:02.392879 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0c32c3c0-6e52-48b5-8350-52dd6326d94e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:02.393314 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0c32c3c0-6e52-48b5-8350-52dd6326d94e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:02.519747 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0c32c3c0-6e52-48b5-8350-52dd6326d94e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:02.527655 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0c32c3c0-6e52-48b5-8350-52dd6326d94e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1557 microversion: 2.1 time: 0.146679 Jun 16 19:49:02.530134 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 424/876] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:02 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:02.547700 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-259d3354-5b5b-46fc-a4fb-9d5100d79797 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:02.548205 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-259d3354-5b5b-46fc-a4fb-9d5100d79797 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:02.555715 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-259d3354-5b5b-46fc-a4fb-9d5100d79797 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:02.556185 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-259d3354-5b5b-46fc-a4fb-9d5100d79797 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:02.556946 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-259d3354-5b5b-46fc-a4fb-9d5100d79797 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:02.557388 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-259d3354-5b5b-46fc-a4fb-9d5100d79797 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:02.647349 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-259d3354-5b5b-46fc-a4fb-9d5100d79797 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105415 Jun 16 19:49:02.647946 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 453/877] 10.222.0.36 () {58 vars in 1274 bytes} [Thu Jun 16 19:49:02 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:02.957069 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-869ee511-ee4c-4383-8971-460fe7e2b593 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:02.957582 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-869ee511-ee4c-4383-8971-460fe7e2b593 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] [instance: 8e487bec-d93f-4777-a2df-96eab8459319] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:02.963595 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-869ee511-ee4c-4383-8971-460fe7e2b593 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:02.964038 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-869ee511-ee4c-4383-8971-460fe7e2b593 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:02.964791 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-869ee511-ee4c-4383-8971-460fe7e2b593 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:02.965218 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-869ee511-ee4c-4383-8971-460fe7e2b593 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:02.969847 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:02.978882 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-869ee511-ee4c-4383-8971-460fe7e2b593 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] HTTP exception thrown: Instance 8e487bec-d93f-4777-a2df-96eab8459319 could not be found. Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-869ee511-ee4c-4383-8971-460fe7e2b593 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Request method failure captured: Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 HTTP/1.1 Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4hilXOgjZ7KEsYHH4dvjvkEaFFD0_QDcF6hjNDsmxOK4VMq2XCWUpWTvPAjR9xWqhptatfZ8PpbHl4h8GF8osNBBi3BWQZ3hw8W2Sf3GusSJrsV9ygn4_OS44rZV-_pfXiQ0EAvDaG4tvx7HwZsXEvQVhHR8YMfC8_3rC46i4UYCZY Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: da06c03197114259aac4bf5444485d51 Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1646040900 Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:49:02.980620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:49:02.982249 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da06c03197114259aac4bf5444485d51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/da06c03197114259aac4bf5444485d51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_da06c03197114259aac4bf5444485d51", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da06c03197114259aac4bf5444485d51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:49:02.982249 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesSnapshotTestJSON-1646040900 Jun 16 19:49:02.982249 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: da06c03197114259aac4bf5444485d51 Jun 16 19:49:02.982249 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1646040900 Jun 16 19:49:02.982249 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesSnapshotTestJSON-1646040900-project Jun 16 19:49:02.982249 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:49:02.982249 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:49:02.982249 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: a7fd310fe0254401b10f6b1517994233 Jun 16 19:49:02.982249 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesSnapshotTestJSON-1646040900-project Jun 16 19:49:02.982249 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:49:02.982249 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance 8e487bec-d93f-4777-a2df-96eab8459319 could not be found. Jun 16 19:49:02.982249 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': '8e487bec-d93f-4777-a2df-96eab8459319'} Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e487bec-d93f-4777-a2df-96eab8459319 could not be found. Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:49:02.986023 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:49:02.987634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:49:02.987634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:49:02.987634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:49:02.987634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:49:02.987634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:49:02.987634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:49:02.987634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:49:02.987634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e487bec-d93f-4777-a2df-96eab8459319 could not be found. Jun 16 19:49:02.987634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:02.987634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:49:02.987634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:02.987634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:49:02.987634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:49:02.987634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:49:02.987634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:49:02.987634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:49:02.987634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e487bec-d93f-4777-a2df-96eab8459319 could not be found. Jun 16 19:49:02.987634 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:02.988810 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-869ee511-ee4c-4383-8971-460fe7e2b593 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] Returning 404 to user: Instance 8e487bec-d93f-4777-a2df-96eab8459319 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:49:02.988810 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-869ee511-ee4c-4383-8971-460fe7e2b593 tempest-VolumesSnapshotTestJSON-1646040900 tempest-VolumesSnapshotTestJSON-1646040900-project] 10.222.0.36 "GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319" status: 404 len: 111 microversion: 2.1 time: 0.029103 Jun 16 19:49:02.988810 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 425/878] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:02 2022] GET /compute/v2.1/servers/8e487bec-d93f-4777-a2df-96eab8459319 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:49:03.769592 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-20989b22-2aba-4223-b76a-6b0330ebc335 req-5c912060-16dd-42c0-9ed1-121f7c9ef10a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5581fbe-6950-4ade-86e0-a1fa41b436ca", "tag": "d9b6745f-75a1-4699-a761-dbf5ba2f0465"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:03.786609 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-20989b22-2aba-4223-b76a-6b0330ebc335 req-5c912060-16dd-42c0-9ed1-121f7c9ef10a service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:03.787090 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-20989b22-2aba-4223-b76a-6b0330ebc335 req-5c912060-16dd-42c0-9ed1-121f7c9ef10a service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:03.799606 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-20989b22-2aba-4223-b76a-6b0330ebc335 req-5c912060-16dd-42c0-9ed1-121f7c9ef10a service nova] Creating event network-changed:d9b6745f-75a1-4699-a761-dbf5ba2f0465 for instance b5581fbe-6950-4ade-86e0-a1fa41b436ca on hv-cinder-84617 Jun 16 19:49:03.805118 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-20989b22-2aba-4223-b76a-6b0330ebc335 req-5c912060-16dd-42c0-9ed1-121f7c9ef10a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101292 Jun 16 19:49:03.805900 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 454/879] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:11.165800 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-820d7684-32e9-48c4-a230-c521f8450b62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:11.166343 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-820d7684-32e9-48c4-a230-c521f8450b62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:11.172794 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-820d7684-32e9-48c4-a230-c521f8450b62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:11.173237 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-820d7684-32e9-48c4-a230-c521f8450b62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:11.173995 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-820d7684-32e9-48c4-a230-c521f8450b62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:11.174425 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-820d7684-32e9-48c4-a230-c521f8450b62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:11.205696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-820d7684-32e9-48c4-a230-c521f8450b62 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/os-volume_attachments/3c36b914-8788-4717-8d99-351004eb6f74" status: 200 len: 194 microversion: 2.20 time: 0.261674 Jun 16 19:49:11.206166 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 426/880] 10.222.0.36 () {60 vars in 1453 bytes} [Thu Jun 16 19:49:10 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/os-volume_attachments/3c36b914-8788-4717-8d99-351004eb6f74 => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:49:11.268783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-71d8e8d9-6e39-4523-b894-643d2f29c0b5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:11.269369 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-71d8e8d9-6e39-4523-b894-643d2f29c0b5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:11.272195 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:11.277098 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-71d8e8d9-6e39-4523-b894-643d2f29c0b5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:11.277537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-71d8e8d9-6e39-4523-b894-643d2f29c0b5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:11.278340 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-71d8e8d9-6e39-4523-b894-643d2f29c0b5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:11.286033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-71d8e8d9-6e39-4523-b894-643d2f29c0b5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:11.368830 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-71d8e8d9-6e39-4523-b894-643d2f29c0b5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lazy-loading 'services' on Instance uuid f667dde1-232e-4f14-917f-0a749279d6a8 {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:49:11.705160 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-71d8e8d9-6e39-4523-b894-643d2f29c0b5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/os-volume_attachments/3c36b914-8788-4717-8d99-351004eb6f74" status: 202 len: 0 microversion: 2.20 time: 0.440537 Jun 16 19:49:11.711477 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 455/881] 10.222.0.36 () {60 vars in 1456 bytes} [Thu Jun 16 19:49:11 2022] DELETE /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/os-volume_attachments/3c36b914-8788-4717-8d99-351004eb6f74 => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:49:11.718287 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-51291de1-c768-42d8-a1cc-26b79b0a8519 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:11.719314 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-51291de1-c768-42d8-a1cc-26b79b0a8519 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:11.725789 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-51291de1-c768-42d8-a1cc-26b79b0a8519 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:11.726233 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-51291de1-c768-42d8-a1cc-26b79b0a8519 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:11.727016 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-51291de1-c768-42d8-a1cc-26b79b0a8519 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:11.727451 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-51291de1-c768-42d8-a1cc-26b79b0a8519 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:11.755615 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-51291de1-c768-42d8-a1cc-26b79b0a8519 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041212 Jun 16 19:49:11.756159 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 427/882] 10.222.0.36 () {60 vars in 1342 bytes} [Thu Jun 16 19:49:11 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:49:12.768427 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a6051a64-d647-4508-b1a7-a67b46c6b55f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:12.769641 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a6051a64-d647-4508-b1a7-a67b46c6b55f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:12.776774 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a6051a64-d647-4508-b1a7-a67b46c6b55f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:12.777286 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a6051a64-d647-4508-b1a7-a67b46c6b55f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:12.778056 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a6051a64-d647-4508-b1a7-a67b46c6b55f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:12.778490 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a6051a64-d647-4508-b1a7-a67b46c6b55f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:12.810575 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a6051a64-d647-4508-b1a7-a67b46c6b55f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047816 Jun 16 19:49:12.811152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 456/883] 10.222.0.36 () {60 vars in 1342 bytes} [Thu Jun 16 19:49:12 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:49:13.822885 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e8707893-79fa-45b7-aa03-aab37f3fddeb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:13.823875 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e8707893-79fa-45b7-aa03-aab37f3fddeb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:13.826134 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=42 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:13.830793 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e8707893-79fa-45b7-aa03-aab37f3fddeb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:13.831276 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e8707893-79fa-45b7-aa03-aab37f3fddeb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:13.832029 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e8707893-79fa-45b7-aa03-aab37f3fddeb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:13.832458 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e8707893-79fa-45b7-aa03-aab37f3fddeb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:13.861699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e8707893-79fa-45b7-aa03-aab37f3fddeb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042675 Jun 16 19:49:13.862262 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 428/884] 10.222.0.36 () {60 vars in 1342 bytes} [Thu Jun 16 19:49:13 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:49:13.923925 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-edd0b37b-e85c-40cf-88bb-17e560596f7f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:13.924578 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-edd0b37b-e85c-40cf-88bb-17e560596f7f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:13.931607 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-edd0b37b-e85c-40cf-88bb-17e560596f7f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:13.934046 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-edd0b37b-e85c-40cf-88bb-17e560596f7f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:13.934046 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-edd0b37b-e85c-40cf-88bb-17e560596f7f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:13.934046 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-edd0b37b-e85c-40cf-88bb-17e560596f7f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:13.959378 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-edd0b37b-e85c-40cf-88bb-17e560596f7f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Going to try to terminate instance {{(pid=124551) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:49:14.385370 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-edd0b37b-e85c-40cf-88bb-17e560596f7f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 204 len: 0 microversion: 2.20 time: 0.465075 Jun 16 19:49:14.385970 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 457/885] 10.222.0.36 () {60 vars in 1279 bytes} [Thu Jun 16 19:49:13 2022] DELETE /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 19:49:14.394492 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-92e60a70-63c1-495b-9fab-921e86529bc0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:14.395350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-92e60a70-63c1-495b-9fab-921e86529bc0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:14.401614 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92e60a70-63c1-495b-9fab-921e86529bc0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:14.402066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92e60a70-63c1-495b-9fab-921e86529bc0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:14.402833 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92e60a70-63c1-495b-9fab-921e86529bc0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:14.403302 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92e60a70-63c1-495b-9fab-921e86529bc0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:14.529860 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-92e60a70-63c1-495b-9fab-921e86529bc0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:14.538064 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-92e60a70-63c1-495b-9fab-921e86529bc0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:14.539679 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-92e60a70-63c1-495b-9fab-921e86529bc0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:14.540911 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-92e60a70-63c1-495b-9fab-921e86529bc0 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.150714 Jun 16 19:49:14.541763 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 429/886] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:14 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:15.559400 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bda60c42-7033-41ff-af40-07cd93b46013 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:15.560094 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-bda60c42-7033-41ff-af40-07cd93b46013 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:15.566521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bda60c42-7033-41ff-af40-07cd93b46013 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:15.567103 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bda60c42-7033-41ff-af40-07cd93b46013 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:15.568116 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bda60c42-7033-41ff-af40-07cd93b46013 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:15.568546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bda60c42-7033-41ff-af40-07cd93b46013 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:15.572685 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:15.704348 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-bda60c42-7033-41ff-af40-07cd93b46013 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:15.712811 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-bda60c42-7033-41ff-af40-07cd93b46013 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:15.714403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-bda60c42-7033-41ff-af40-07cd93b46013 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:15.715593 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-bda60c42-7033-41ff-af40-07cd93b46013 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.160555 Jun 16 19:49:15.716142 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 458/887] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:15 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:16.735231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-52e88174-6a66-4f2e-a3da-595888a20574 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:16.735855 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-52e88174-6a66-4f2e-a3da-595888a20574 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:16.742623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-52e88174-6a66-4f2e-a3da-595888a20574 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:16.743104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-52e88174-6a66-4f2e-a3da-595888a20574 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:16.743875 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-52e88174-6a66-4f2e-a3da-595888a20574 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:16.744307 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-52e88174-6a66-4f2e-a3da-595888a20574 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:16.873526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-52e88174-6a66-4f2e-a3da-595888a20574 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:16.883303 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-52e88174-6a66-4f2e-a3da-595888a20574 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:16.886861 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-52e88174-6a66-4f2e-a3da-595888a20574 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:16.886861 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-52e88174-6a66-4f2e-a3da-595888a20574 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1722 microversion: 2.20 time: 0.154693 Jun 16 19:49:16.886861 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 430/888] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:16 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:17.231756 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-66926842-a5b0-4bd8-809e-d82b4bcdb75e req-28d1deb4-4637-4f50-a713-0fb92b72a22b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f667dde1-232e-4f14-917f-0a749279d6a8", "name": "network-vif-deleted", "tag": "ce7582ec-7186-425a-a407-f177022e1f52"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:17.241592 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-66926842-a5b0-4bd8-809e-d82b4bcdb75e req-28d1deb4-4637-4f50-a713-0fb92b72a22b service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:17.242042 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-66926842-a5b0-4bd8-809e-d82b4bcdb75e req-28d1deb4-4637-4f50-a713-0fb92b72a22b service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:17.260637 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-66926842-a5b0-4bd8-809e-d82b4bcdb75e req-28d1deb4-4637-4f50-a713-0fb92b72a22b service nova] Creating event network-vif-deleted:ce7582ec-7186-425a-a407-f177022e1f52 for instance f667dde1-232e-4f14-917f-0a749279d6a8 on hv-cinder-84617 Jun 16 19:49:17.266363 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-66926842-a5b0-4bd8-809e-d82b4bcdb75e req-28d1deb4-4637-4f50-a713-0fb92b72a22b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101506 Jun 16 19:49:17.267336 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 459/889] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:17.904838 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e07e72ed-cb60-4338-8674-1a747239e516 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:17.905443 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e07e72ed-cb60-4338-8674-1a747239e516 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:17.914850 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e07e72ed-cb60-4338-8674-1a747239e516 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:17.915488 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e07e72ed-cb60-4338-8674-1a747239e516 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:17.917389 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e07e72ed-cb60-4338-8674-1a747239e516 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:17.918021 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e07e72ed-cb60-4338-8674-1a747239e516 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:17.982107 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e07e72ed-cb60-4338-8674-1a747239e516 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:17.990447 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e07e72ed-cb60-4338-8674-1a747239e516 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:17.991960 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e07e72ed-cb60-4338-8674-1a747239e516 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:17.993099 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e07e72ed-cb60-4338-8674-1a747239e516 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1654 microversion: 2.20 time: 0.092150 Jun 16 19:49:17.993644 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 431/890] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:17 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1654 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:19.012176 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-2f4b93a9-cbe9-4625-8313-f948cee8c6d2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:19.012881 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-2f4b93a9-cbe9-4625-8313-f948cee8c6d2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:19.019073 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2f4b93a9-cbe9-4625-8313-f948cee8c6d2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:19.019526 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2f4b93a9-cbe9-4625-8313-f948cee8c6d2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:19.020292 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2f4b93a9-cbe9-4625-8313-f948cee8c6d2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:19.020731 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2f4b93a9-cbe9-4625-8313-f948cee8c6d2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:19.081918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-2f4b93a9-cbe9-4625-8313-f948cee8c6d2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:19.089816 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-2f4b93a9-cbe9-4625-8313-f948cee8c6d2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:19.091341 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-2f4b93a9-cbe9-4625-8313-f948cee8c6d2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:19.092469 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-2f4b93a9-cbe9-4625-8313-f948cee8c6d2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1365 microversion: 2.20 time: 0.085079 Jun 16 19:49:19.093044 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 460/891] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:19 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1365 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:20.110860 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9b73d352-975d-40ff-b8e6-3993ae14cf74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:20.111479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9b73d352-975d-40ff-b8e6-3993ae14cf74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:20.117852 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9b73d352-975d-40ff-b8e6-3993ae14cf74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:20.118290 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9b73d352-975d-40ff-b8e6-3993ae14cf74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:20.119066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9b73d352-975d-40ff-b8e6-3993ae14cf74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:20.119495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9b73d352-975d-40ff-b8e6-3993ae14cf74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:20.149297 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9b73d352-975d-40ff-b8e6-3993ae14cf74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:20.149735 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9b73d352-975d-40ff-b8e6-3993ae14cf74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:20.150181 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-9b73d352-975d-40ff-b8e6-3993ae14cf74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lazy-loading 'fault' on Instance uuid f667dde1-232e-4f14-917f-0a749279d6a8 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:49:20.193058 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9b73d352-975d-40ff-b8e6-3993ae14cf74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:20.200999 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9b73d352-975d-40ff-b8e6-3993ae14cf74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:20.202525 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9b73d352-975d-40ff-b8e6-3993ae14cf74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:20.203682 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9b73d352-975d-40ff-b8e6-3993ae14cf74 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 200 len: 1370 microversion: 2.20 time: 0.096722 Jun 16 19:49:20.204222 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 432/892] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:20 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 1370 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:49:21.221884 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-26a3f7ef-f964-4884-a3f6-d9c018e4dbc2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:21.222530 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-26a3f7ef-f964-4884-a3f6-d9c018e4dbc2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:21.229853 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-26a3f7ef-f964-4884-a3f6-d9c018e4dbc2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:21.230310 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-26a3f7ef-f964-4884-a3f6-d9c018e4dbc2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:21.231790 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-26a3f7ef-f964-4884-a3f6-d9c018e4dbc2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:21.232235 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-26a3f7ef-f964-4884-a3f6-d9c018e4dbc2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:21.246949 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-26a3f7ef-f964-4884-a3f6-d9c018e4dbc2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] HTTP exception thrown: Instance f667dde1-232e-4f14-917f-0a749279d6a8 could not be found. Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-26a3f7ef-f964-4884-a3f6-d9c018e4dbc2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Request method failure captured: Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 HTTP/1.1 Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4fuF48kNvkcNQeEjE8tJoECAJsaDQhoGQWc5qC1SqIAqTJKM2Jw7679gQ2F00Fu5MKD94wZ3LDhOFV7qm6yEwPJNKsXffaIRbj8c74SxV-T540QYq8P1gqh-8-MhAgGulq_TmPG_4JZIAJIzrtj1FOqhUbJhpU5rbp9oQ8q-PFoTAI Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 38629fbda01748eb98e2dca20a3da10a Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-906332430 Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:49:21.248627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:49:21.250063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38629fbda01748eb98e2dca20a3da10a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/38629fbda01748eb98e2dca20a3da10a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_38629fbda01748eb98e2dca20a3da10a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38629fbda01748eb98e2dca20a3da10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:49:21.250063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-AttachVolumeShelveTestJSON-906332430 Jun 16 19:49:21.250063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 38629fbda01748eb98e2dca20a3da10a Jun 16 19:49:21.250063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-906332430 Jun 16 19:49:21.250063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-AttachVolumeShelveTestJSON-906332430-project Jun 16 19:49:21.250063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:49:21.250063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:49:21.250063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 8b5a188cee0d4727a14153088b8d95c6 Jun 16 19:49:21.250063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-AttachVolumeShelveTestJSON-906332430-project Jun 16 19:49:21.250063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:49:21.250063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance f667dde1-232e-4f14-917f-0a749279d6a8 could not be found. Jun 16 19:49:21.250063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': 'f667dde1-232e-4f14-917f-0a749279d6a8'} Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f667dde1-232e-4f14-917f-0a749279d6a8 could not be found. Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:49:21.251524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:49:21.253061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:49:21.253061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:49:21.253061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:49:21.253061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:49:21.253061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:49:21.253061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:49:21.253061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:49:21.253061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f667dde1-232e-4f14-917f-0a749279d6a8 could not be found. Jun 16 19:49:21.253061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:49:21.253061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:49:21.253061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:49:21.253061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:49:21.253061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:49:21.253061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:49:21.253061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:49:21.253061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:49:21.253061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f667dde1-232e-4f14-917f-0a749279d6a8 could not be found. Jun 16 19:49:21.253061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:49:21.254727 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-26a3f7ef-f964-4884-a3f6-d9c018e4dbc2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Returning 404 to user: Instance f667dde1-232e-4f14-917f-0a749279d6a8 could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:49:21.254727 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-26a3f7ef-f964-4884-a3f6-d9c018e4dbc2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 404 len: 111 microversion: 2.20 time: 0.032285 Jun 16 19:49:21.254727 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 461/893] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:21 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:49:21.259088 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ddf2256d-9647-4dfc-9f76-fc368ceee2d1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '.version_select at 0x7f0505cfa8b0>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:21.346104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ddf2256d-9647-4dfc-9f76-fc368ceee2d1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-486232491" status: 204 len: 0 microversion: 2.20 time: 0.090896 Jun 16 19:49:21.346620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 433/894] 10.222.0.36 () {60 vars in 1258 bytes} [Thu Jun 16 19:49:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-486232491 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 19:49:22.163740 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-529eaf94-40ac-40b9-98e3-7d69bf178eaa tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:22.164177 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-529eaf94-40ac-40b9-98e3-7d69bf178eaa tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:22.170885 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-529eaf94-40ac-40b9-98e3-7d69bf178eaa tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:22.171372 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-529eaf94-40ac-40b9-98e3-7d69bf178eaa tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:22.172375 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-529eaf94-40ac-40b9-98e3-7d69bf178eaa tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:22.172809 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-529eaf94-40ac-40b9-98e3-7d69bf178eaa tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:22.267822 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-529eaf94-40ac-40b9-98e3-7d69bf178eaa tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lazy-loading 'services' on Instance uuid ea242cf7-0535-4532-aaa0-59848bf41c73 {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:49:22.432361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f0b6493a-27b0-487b-a8bb-9e9f857d38d7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Action: 'create', calling method: .version_select at 0x7f0505cce160>, body: {"keypair": {"name": "tempest-keypair-1609834858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4rninuWo0xhwoWil0WrbzCMituUBY5pgYFzSbks1ayKWNVnIsqxIfjvn+XlYuG+xPU43iHXMBMTO+eBipMASQpIQOKuM+fp/t1Id43Swfgne5UjDJ8ZDIkc6LSghFFqw=="}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:22.446901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-f0b6493a-27b0-487b-a8bb-9e9f857d38d7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Getting quotas for project 38629fbda01748eb98e2dca20a3da10a. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:49:22.450639 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-f0b6493a-27b0-487b-a8bb-9e9f857d38d7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Getting quotas for user 8b5a188cee0d4727a14153088b8d95c6 and project 38629fbda01748eb98e2dca20a3da10a. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:49:22.567827 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-529eaf94-40ac-40b9-98e3-7d69bf178eaa tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/os-volume_attachments/934bcd4e-feb8-42b0-904d-450591281c81" status: 202 len: 0 microversion: 2.1 time: 0.407568 Jun 16 19:49:22.571415 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 462/895] 10.222.0.36 () {58 vars in 1415 bytes} [Thu Jun 16 19:49:22 2022] DELETE /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/os-volume_attachments/934bcd4e-feb8-42b0-904d-450591281c81 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:49:22.577551 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-2c0d0e39-3a85-488e-8192-1a12f6af1d3d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:22.578630 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-2c0d0e39-3a85-488e-8192-1a12f6af1d3d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:22.585152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2c0d0e39-3a85-488e-8192-1a12f6af1d3d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:22.585605 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2c0d0e39-3a85-488e-8192-1a12f6af1d3d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:22.586439 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2c0d0e39-3a85-488e-8192-1a12f6af1d3d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:22.586882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2c0d0e39-3a85-488e-8192-1a12f6af1d3d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:22.617277 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-2c0d0e39-3a85-488e-8192-1a12f6af1d3d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044194 Jun 16 19:49:22.617832 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 463/896] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:49:22 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:22.666679 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f0b6493a-27b0-487b-a8bb-9e9f857d38d7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.238620 Jun 16 19:49:22.667404 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 434/897] 10.222.0.36 () {62 vars in 1199 bytes} [Thu Jun 16 19:49:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 240 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 16 19:49:23.628692 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-2c4738af-3e3c-41b9-809d-754707f195d5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:23.630260 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-2c4738af-3e3c-41b9-809d-754707f195d5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:23.637350 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2c4738af-3e3c-41b9-809d-754707f195d5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:23.637804 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2c4738af-3e3c-41b9-809d-754707f195d5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:23.638804 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2c4738af-3e3c-41b9-809d-754707f195d5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:23.639014 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2c4738af-3e3c-41b9-809d-754707f195d5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:23.670036 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-2c4738af-3e3c-41b9-809d-754707f195d5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045206 Jun 16 19:49:23.670605 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 464/898] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:49:23 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:24.681350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-093f8279-38e9-404f-837c-e1607174bff5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:24.682269 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-093f8279-38e9-404f-837c-e1607174bff5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:24.688447 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-093f8279-38e9-404f-837c-e1607174bff5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:24.688898 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-093f8279-38e9-404f-837c-e1607174bff5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:24.689652 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-093f8279-38e9-404f-837c-e1607174bff5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:24.690084 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-093f8279-38e9-404f-837c-e1607174bff5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:24.718203 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-093f8279-38e9-404f-837c-e1607174bff5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040737 Jun 16 19:49:24.718957 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 435/899] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:49:24 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:49:24.794258 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5d4f2e7b-b9aa-4f47-80fa-9a6157a39b64 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:24.795615 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5d4f2e7b-b9aa-4f47-80fa-9a6157a39b64 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:24.804189 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d4f2e7b-b9aa-4f47-80fa-9a6157a39b64 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:24.804645 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d4f2e7b-b9aa-4f47-80fa-9a6157a39b64 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:24.805527 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d4f2e7b-b9aa-4f47-80fa-9a6157a39b64 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:24.805970 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d4f2e7b-b9aa-4f47-80fa-9a6157a39b64 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:24.834829 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5d4f2e7b-b9aa-4f47-80fa-9a6157a39b64 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Going to try to terminate instance {{(pid=124551) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:49:25.374280 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5d4f2e7b-b9aa-4f47-80fa-9a6157a39b64 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 204 len: 0 microversion: 2.1 time: 0.584419 Jun 16 19:49:25.374878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 465/900] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:49:24 2022] DELETE /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:49:25.383450 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5a87adb6-089c-45d7-a858-320f4683636c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:25.384089 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5a87adb6-089c-45d7-a858-320f4683636c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:25.389957 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5a87adb6-089c-45d7-a858-320f4683636c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:25.390410 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5a87adb6-089c-45d7-a858-320f4683636c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:25.391196 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5a87adb6-089c-45d7-a858-320f4683636c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:25.391637 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5a87adb6-089c-45d7-a858-320f4683636c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:25.518098 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-004c774a-0c0a-4734-971a-b481fee82c8d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-222877712", "imageRef": "9fcb2be6-02db-4853-a8d6-6478a75f26a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44cabd56-11ef-4367-ae58-e8df153d2567"}], "security_groups": [{"name": "tempest-securitygroup--591788300"}], "key_name": "tempest-keypair-1609834858", "user_data": "}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:25.528884 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5a87adb6-089c-45d7-a858-320f4683636c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:25.536159 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5a87adb6-089c-45d7-a858-320f4683636c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1689 microversion: 2.1 time: 0.156985 Jun 16 19:49:25.536992 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 436/901] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:25 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:25.620758 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.network.neutron [None req-004c774a-0c0a-4734-971a-b481fee82c8d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] validate_networks() for [('44cabd56-11ef-4367-ae58-e8df153d2567', None, None, None, None, None)] {{(pid=124551) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:49:26.081083 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-004c774a-0c0a-4734-971a-b481fee82c8d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Flavor limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:49:26.081679 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-004c774a-0c0a-4734-971a-b481fee82c8d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Image limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:49:26.081956 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-004c774a-0c0a-4734-971a-b481fee82c8d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Flavor pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:49:26.082862 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-004c774a-0c0a-4734-971a-b481fee82c8d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Image pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:49:26.083285 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-004c774a-0c0a-4734-971a-b481fee82c8d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:49:26.092006 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-004c774a-0c0a-4734-971a-b481fee82c8d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:26.092466 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-004c774a-0c0a-4734-971a-b481fee82c8d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:26.093255 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-004c774a-0c0a-4734-971a-b481fee82c8d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:26.093690 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-004c774a-0c0a-4734-971a-b481fee82c8d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:26.110322 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-004c774a-0c0a-4734-971a-b481fee82c8d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Getting quotas for project 38629fbda01748eb98e2dca20a3da10a. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:49:26.114226 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-004c774a-0c0a-4734-971a-b481fee82c8d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Getting quotas for user 8b5a188cee0d4727a14153088b8d95c6 and project 38629fbda01748eb98e2dca20a3da10a. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:49:26.124923 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-004c774a-0c0a-4734-971a-b481fee82c8d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Going to run 1 instances... {{(pid=124551) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:49:26.127264 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-004c774a-0c0a-4734-971a-b481fee82c8d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcb2be6-02db-4853-a8d6-6478a75f26a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:49:26.299494 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-004c774a-0c0a-4734-971a-b481fee82c8d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.783487 Jun 16 19:49:26.299494 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 466/902] 10.222.0.36 () {62 vars in 1187 bytes} [Thu Jun 16 19:49:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 19:49:26.308427 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-395bde36-4c65-4cba-8e93-aa3ace33ea73 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:26.309032 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-395bde36-4c65-4cba-8e93-aa3ace33ea73 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:26.372755 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-395bde36-4c65-4cba-8e93-aa3ace33ea73 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:26.380406 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-395bde36-4c65-4cba-8e93-aa3ace33ea73 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:26.381891 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-395bde36-4c65-4cba-8e93-aa3ace33ea73 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:26.383428 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-395bde36-4c65-4cba-8e93-aa3ace33ea73 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1281 microversion: 2.20 time: 0.078831 Jun 16 19:49:26.383973 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 437/903] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:26 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1281 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:26.554050 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-33e22421-8c75-4a7e-a597-fa9c25472dbf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:26.554674 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-33e22421-8c75-4a7e-a597-fa9c25472dbf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:26.561985 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-33e22421-8c75-4a7e-a597-fa9c25472dbf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:26.562437 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-33e22421-8c75-4a7e-a597-fa9c25472dbf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:26.563242 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-33e22421-8c75-4a7e-a597-fa9c25472dbf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:26.563682 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-33e22421-8c75-4a7e-a597-fa9c25472dbf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:26.697873 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-33e22421-8c75-4a7e-a597-fa9c25472dbf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:26.705409 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-33e22421-8c75-4a7e-a597-fa9c25472dbf tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1689 microversion: 2.1 time: 0.155943 Jun 16 19:49:26.705977 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 467/904] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:26 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:27.401313 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0b59dfc7-e83c-4329-8f9d-a6542bd52ba3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:27.401972 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0b59dfc7-e83c-4329-8f9d-a6542bd52ba3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:27.409376 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0b59dfc7-e83c-4329-8f9d-a6542bd52ba3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:27.412164 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0b59dfc7-e83c-4329-8f9d-a6542bd52ba3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:27.412164 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0b59dfc7-e83c-4329-8f9d-a6542bd52ba3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:27.412164 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0b59dfc7-e83c-4329-8f9d-a6542bd52ba3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:27.470822 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0b59dfc7-e83c-4329-8f9d-a6542bd52ba3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:27.479230 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0b59dfc7-e83c-4329-8f9d-a6542bd52ba3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:27.480737 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0b59dfc7-e83c-4329-8f9d-a6542bd52ba3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:27.481831 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0b59dfc7-e83c-4329-8f9d-a6542bd52ba3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1285 microversion: 2.20 time: 0.084407 Jun 16 19:49:27.482390 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 438/905] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:27 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:27.723491 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6c0c117c-6b78-4d2b-a563-61a409c1493d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:27.724109 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6c0c117c-6b78-4d2b-a563-61a409c1493d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:27.730688 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6c0c117c-6b78-4d2b-a563-61a409c1493d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:27.731219 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6c0c117c-6b78-4d2b-a563-61a409c1493d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:27.731997 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6c0c117c-6b78-4d2b-a563-61a409c1493d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:27.732442 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6c0c117c-6b78-4d2b-a563-61a409c1493d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:27.860735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6c0c117c-6b78-4d2b-a563-61a409c1493d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:27.868271 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6c0c117c-6b78-4d2b-a563-61a409c1493d tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1689 microversion: 2.1 time: 0.149330 Jun 16 19:49:27.868834 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 468/906] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:27 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:28.499833 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c16a60cb-e9b0-4186-9df8-eb0e9399f637 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:28.500469 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c16a60cb-e9b0-4186-9df8-eb0e9399f637 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:28.507648 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c16a60cb-e9b0-4186-9df8-eb0e9399f637 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:28.508098 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c16a60cb-e9b0-4186-9df8-eb0e9399f637 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:28.512143 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c16a60cb-e9b0-4186-9df8-eb0e9399f637 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:28.512143 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c16a60cb-e9b0-4186-9df8-eb0e9399f637 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:28.570286 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c16a60cb-e9b0-4186-9df8-eb0e9399f637 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:28.578109 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c16a60cb-e9b0-4186-9df8-eb0e9399f637 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:28.579641 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c16a60cb-e9b0-4186-9df8-eb0e9399f637 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:28.580736 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c16a60cb-e9b0-4186-9df8-eb0e9399f637 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1285 microversion: 2.20 time: 0.084826 Jun 16 19:49:28.581282 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 439/907] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:28 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:28.884902 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bf49d800-ed7d-461a-97b4-e122d5f1801e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:28.885584 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-bf49d800-ed7d-461a-97b4-e122d5f1801e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:28.892001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bf49d800-ed7d-461a-97b4-e122d5f1801e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:28.895162 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bf49d800-ed7d-461a-97b4-e122d5f1801e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:28.895162 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bf49d800-ed7d-461a-97b4-e122d5f1801e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:28.895162 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bf49d800-ed7d-461a-97b4-e122d5f1801e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:29.044203 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-bf49d800-ed7d-461a-97b4-e122d5f1801e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:29.052701 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-bf49d800-ed7d-461a-97b4-e122d5f1801e tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1689 microversion: 2.1 time: 0.171771 Jun 16 19:49:29.053287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 469/908] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:28 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:29.598978 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ec635738-df03-4815-9748-2bc0e90bbfb6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:29.599592 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ec635738-df03-4815-9748-2bc0e90bbfb6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:29.605899 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec635738-df03-4815-9748-2bc0e90bbfb6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:29.606340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec635738-df03-4815-9748-2bc0e90bbfb6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:29.607119 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec635738-df03-4815-9748-2bc0e90bbfb6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:29.607551 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec635738-df03-4815-9748-2bc0e90bbfb6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:29.671716 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ec635738-df03-4815-9748-2bc0e90bbfb6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:29.681512 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ec635738-df03-4815-9748-2bc0e90bbfb6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:29.688726 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ec635738-df03-4815-9748-2bc0e90bbfb6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:29.688726 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ec635738-df03-4815-9748-2bc0e90bbfb6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1333 microversion: 2.20 time: 0.089283 Jun 16 19:49:29.688726 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 440/909] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:29 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:29.979567 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-bc62f867-487b-413e-89b2-a5c660360d42 req-6e0a058d-3a9e-43c2-bc62-5a518e19de8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea242cf7-0535-4532-aaa0-59848bf41c73", "name": "network-vif-deleted", "tag": "521225d6-b4cf-4644-b00e-7e1640cf92c7"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:29.985067 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-bc62f867-487b-413e-89b2-a5c660360d42 req-6e0a058d-3a9e-43c2-bc62-5a518e19de8d service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:29.985512 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-bc62f867-487b-413e-89b2-a5c660360d42 req-6e0a058d-3a9e-43c2-bc62-5a518e19de8d service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:29.996619 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-bc62f867-487b-413e-89b2-a5c660360d42 req-6e0a058d-3a9e-43c2-bc62-5a518e19de8d service nova] Creating event network-vif-deleted:521225d6-b4cf-4644-b00e-7e1640cf92c7 for instance ea242cf7-0535-4532-aaa0-59848bf41c73 on hv-cinder-84617 Jun 16 19:49:30.001456 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-bc62f867-487b-413e-89b2-a5c660360d42 req-6e0a058d-3a9e-43c2-bc62-5a518e19de8d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029440 Jun 16 19:49:30.002088 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 470/910] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:30.070511 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-219e2822-d1fd-4df6-9cf6-b44400c73735 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:30.072354 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-219e2822-d1fd-4df6-9cf6-b44400c73735 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:30.088281 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-219e2822-d1fd-4df6-9cf6-b44400c73735 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:30.089033 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-219e2822-d1fd-4df6-9cf6-b44400c73735 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:30.090157 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-219e2822-d1fd-4df6-9cf6-b44400c73735 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:30.090761 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-219e2822-d1fd-4df6-9cf6-b44400c73735 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:30.172741 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-219e2822-d1fd-4df6-9cf6-b44400c73735 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:30.182360 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-219e2822-d1fd-4df6-9cf6-b44400c73735 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1622 microversion: 2.1 time: 0.116477 Jun 16 19:49:30.184304 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 441/911] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:30 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1622 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:30.708225 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f512ea07-ef3c-4291-8053-19add623d631 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:30.708225 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f512ea07-ef3c-4291-8053-19add623d631 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:30.714706 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f512ea07-ef3c-4291-8053-19add623d631 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:30.715476 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f512ea07-ef3c-4291-8053-19add623d631 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:30.716250 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f512ea07-ef3c-4291-8053-19add623d631 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:30.716826 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f512ea07-ef3c-4291-8053-19add623d631 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:30.794233 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f512ea07-ef3c-4291-8053-19add623d631 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:30.801614 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f512ea07-ef3c-4291-8053-19add623d631 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:30.803202 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f512ea07-ef3c-4291-8053-19add623d631 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:30.804505 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f512ea07-ef3c-4291-8053-19add623d631 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1351 microversion: 2.20 time: 0.105539 Jun 16 19:49:30.805087 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 471/912] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:30 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:31.200465 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-34223a2c-c105-4d18-b3af-3fb7d8cfca23 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:31.201076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-34223a2c-c105-4d18-b3af-3fb7d8cfca23 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:31.208087 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-34223a2c-c105-4d18-b3af-3fb7d8cfca23 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:31.208533 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-34223a2c-c105-4d18-b3af-3fb7d8cfca23 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:31.209339 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-34223a2c-c105-4d18-b3af-3fb7d8cfca23 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:31.209772 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-34223a2c-c105-4d18-b3af-3fb7d8cfca23 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:31.243430 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-34223a2c-c105-4d18-b3af-3fb7d8cfca23 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:31.244029 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-34223a2c-c105-4d18-b3af-3fb7d8cfca23 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:31.244659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-34223a2c-c105-4d18-b3af-3fb7d8cfca23 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lazy-loading 'fault' on Instance uuid ea242cf7-0535-4532-aaa0-59848bf41c73 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:49:31.314852 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-34223a2c-c105-4d18-b3af-3fb7d8cfca23 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:31.328746 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-34223a2c-c105-4d18-b3af-3fb7d8cfca23 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 200 len: 1336 microversion: 2.1 time: 0.130258 Jun 16 19:49:31.328746 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 442/913] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:31 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 1336 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:31.822408 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-cc47b529-dac5-47a5-931f-a3b4939e7564 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:31.823056 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-cc47b529-dac5-47a5-931f-a3b4939e7564 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:31.829613 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cc47b529-dac5-47a5-931f-a3b4939e7564 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:31.830063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cc47b529-dac5-47a5-931f-a3b4939e7564 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:31.839488 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cc47b529-dac5-47a5-931f-a3b4939e7564 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:31.839488 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cc47b529-dac5-47a5-931f-a3b4939e7564 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:31.958347 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-cc47b529-dac5-47a5-931f-a3b4939e7564 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:31.970430 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-cc47b529-dac5-47a5-931f-a3b4939e7564 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:31.971956 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-cc47b529-dac5-47a5-931f-a3b4939e7564 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:31.973721 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-cc47b529-dac5-47a5-931f-a3b4939e7564 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1406 microversion: 2.20 time: 0.155271 Jun 16 19:49:31.974270 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 472/914] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:31 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:32.345445 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b07f7c5d-2fcf-4491-9e47-09701bfb9d17 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:32.346671 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b07f7c5d-2fcf-4491-9e47-09701bfb9d17 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: ea242cf7-0535-4532-aaa0-59848bf41c73] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:32.356000 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b07f7c5d-2fcf-4491-9e47-09701bfb9d17 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:32.358495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b07f7c5d-2fcf-4491-9e47-09701bfb9d17 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:32.358495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b07f7c5d-2fcf-4491-9e47-09701bfb9d17 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:32.358495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b07f7c5d-2fcf-4491-9e47-09701bfb9d17 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:32.374210 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-b07f7c5d-2fcf-4491-9e47-09701bfb9d17 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] HTTP exception thrown: Instance ea242cf7-0535-4532-aaa0-59848bf41c73 could not be found. Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b07f7c5d-2fcf-4491-9e47-09701bfb9d17 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Request method failure captured: Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 HTTP/1.1 Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4f2bJrSUVHDMMTqU2Jad-fuYa-ofXk1y9tRV-Se49xlEwwcbihzp3u5EHqEbpzFBj_5sSZbxubYd39VX764172H-VM9cSazwalfJq36RSCcub4-RnQ89lgkzUX_84lIDug8hDGmNJ1OxRyHEdc235OBU20Fo3EaYIsAMLvUvs-yb6k Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 7153c09b2d0b4805ad0360afb7ecd3ca Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-842795293 Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:49:32.375826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:49:32.377204 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7153c09b2d0b4805ad0360afb7ecd3ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7153c09b2d0b4805ad0360afb7ecd3ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7153c09b2d0b4805ad0360afb7ecd3ca", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7153c09b2d0b4805ad0360afb7ecd3ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:49:32.377204 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-ServerRescueNegativeTestJSON-842795293 Jun 16 19:49:32.377204 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 7153c09b2d0b4805ad0360afb7ecd3ca Jun 16 19:49:32.377204 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-842795293 Jun 16 19:49:32.377204 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-ServerRescueNegativeTestJSON-842795293-project Jun 16 19:49:32.377204 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:49:32.377204 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:49:32.377204 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 2d0d5723417d4b60bc51e47f28d09902 Jun 16 19:49:32.377204 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-ServerRescueNegativeTestJSON-842795293-project Jun 16 19:49:32.377204 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:49:32.377204 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance ea242cf7-0535-4532-aaa0-59848bf41c73 could not be found. Jun 16 19:49:32.377204 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': 'ea242cf7-0535-4532-aaa0-59848bf41c73'} Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea242cf7-0535-4532-aaa0-59848bf41c73 could not be found. Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:49:32.377985 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:49:32.381150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:49:32.381150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:49:32.381150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:49:32.381150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:49:32.381150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:49:32.381150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:49:32.381150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:49:32.381150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea242cf7-0535-4532-aaa0-59848bf41c73 could not be found. Jun 16 19:49:32.381150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:32.381150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:49:32.381150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:32.381150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:49:32.381150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:49:32.381150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:49:32.381150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:49:32.381150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:49:32.381150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea242cf7-0535-4532-aaa0-59848bf41c73 could not be found. Jun 16 19:49:32.381150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:32.384039 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b07f7c5d-2fcf-4491-9e47-09701bfb9d17 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Returning 404 to user: Instance ea242cf7-0535-4532-aaa0-59848bf41c73 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:49:32.384039 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b07f7c5d-2fcf-4491-9e47-09701bfb9d17 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73" status: 404 len: 111 microversion: 2.1 time: 0.036878 Jun 16 19:49:32.384039 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 443/915] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:32 2022] GET /compute/v2.1/servers/ea242cf7-0535-4532-aaa0-59848bf41c73 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:49:32.387618 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-cba11783-3b6b-4a41-bd08-95ed1143035f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '.version_select at 0x7f0501546c10>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:32.397516 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-a4f344ed-92dc-4fa6-b65c-11c2105c0b03 req-9683e553-c19e-4bd9-93a2-dcf49e5a0602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "763636a9-34c8-47b8-8f39-fdbc2ff40e23", "tag": "6a3e5e5b-38d9-46c6-86d4-f4326eeff1a1"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:32.407929 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-a4f344ed-92dc-4fa6-b65c-11c2105c0b03 req-9683e553-c19e-4bd9-93a2-dcf49e5a0602 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:32.408977 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-a4f344ed-92dc-4fa6-b65c-11c2105c0b03 req-9683e553-c19e-4bd9-93a2-dcf49e5a0602 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:32.420367 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-a4f344ed-92dc-4fa6-b65c-11c2105c0b03 req-9683e553-c19e-4bd9-93a2-dcf49e5a0602 service nova] Creating event network-changed:6a3e5e5b-38d9-46c6-86d4-f4326eeff1a1 for instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 on hv-cinder-84617 Jun 16 19:49:32.430541 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-a4f344ed-92dc-4fa6-b65c-11c2105c0b03 req-9683e553-c19e-4bd9-93a2-dcf49e5a0602 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033076 Jun 16 19:49:32.430541 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 444/916] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:32.570230 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-cba11783-3b6b-4a41-bd08-95ed1143035f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1482909140" status: 202 len: 0 microversion: 2.1 time: 0.186450 Jun 16 19:49:32.571353 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 473/917] 10.222.0.36 () {58 vars in 1220 bytes} [Thu Jun 16 19:49:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1482909140 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:49:32.994257 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4a69db9d-e9ad-433b-a9e6-b2695e6ab14f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:32.994986 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4a69db9d-e9ad-433b-a9e6-b2695e6ab14f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:33.001334 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a69db9d-e9ad-433b-a9e6-b2695e6ab14f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:33.002382 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a69db9d-e9ad-433b-a9e6-b2695e6ab14f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:33.003217 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a69db9d-e9ad-433b-a9e6-b2695e6ab14f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:33.005016 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a69db9d-e9ad-433b-a9e6-b2695e6ab14f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:33.515762 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4a69db9d-e9ad-433b-a9e6-b2695e6ab14f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:33.524721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4a69db9d-e9ad-433b-a9e6-b2695e6ab14f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:33.526246 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4a69db9d-e9ad-433b-a9e6-b2695e6ab14f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:33.527732 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4a69db9d-e9ad-433b-a9e6-b2695e6ab14f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1406 microversion: 2.20 time: 0.538512 Jun 16 19:49:33.529802 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 445/918] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:32 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1406 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:34.550032 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7dd8912a-c334-4f3f-995e-e7617839c510 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:34.551164 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-7dd8912a-c334-4f3f-995e-e7617839c510 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:34.557352 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7dd8912a-c334-4f3f-995e-e7617839c510 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:34.557807 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7dd8912a-c334-4f3f-995e-e7617839c510 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:34.558572 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7dd8912a-c334-4f3f-995e-e7617839c510 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:34.559036 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7dd8912a-c334-4f3f-995e-e7617839c510 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:34.695686 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-7dd8912a-c334-4f3f-995e-e7617839c510 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:34.703734 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-7dd8912a-c334-4f3f-995e-e7617839c510 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:34.705311 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-7dd8912a-c334-4f3f-995e-e7617839c510 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:34.706420 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-7dd8912a-c334-4f3f-995e-e7617839c510 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1406 microversion: 2.20 time: 0.161026 Jun 16 19:49:34.707072 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 474/919] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:34 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:35.724507 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fd762e7a-20d2-4954-912f-a1cfc73a49b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:35.725144 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fd762e7a-20d2-4954-912f-a1cfc73a49b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:35.731608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd762e7a-20d2-4954-912f-a1cfc73a49b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:35.732055 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd762e7a-20d2-4954-912f-a1cfc73a49b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:35.732811 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd762e7a-20d2-4954-912f-a1cfc73a49b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:35.733244 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd762e7a-20d2-4954-912f-a1cfc73a49b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:35.737150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:35.868842 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fd762e7a-20d2-4954-912f-a1cfc73a49b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:35.877397 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fd762e7a-20d2-4954-912f-a1cfc73a49b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:35.879588 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fd762e7a-20d2-4954-912f-a1cfc73a49b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:35.880729 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fd762e7a-20d2-4954-912f-a1cfc73a49b4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1406 microversion: 2.20 time: 0.160117 Jun 16 19:49:35.881298 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 446/920] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:35 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:36.149381 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0eab6e67-6a73-410b-9f63-25b3a1c3482b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:36.149924 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0eab6e67-6a73-410b-9f63-25b3a1c3482b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:36.152738 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=2 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:36.153504 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=6 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:36.158377 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0eab6e67-6a73-410b-9f63-25b3a1c3482b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:36.158828 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0eab6e67-6a73-410b-9f63-25b3a1c3482b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:36.160134 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0eab6e67-6a73-410b-9f63-25b3a1c3482b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:36.160580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0eab6e67-6a73-410b-9f63-25b3a1c3482b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:36.188833 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0eab6e67-6a73-410b-9f63-25b3a1c3482b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Going to try to terminate instance {{(pid=124551) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:49:36.203331 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:36.567575 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0eab6e67-6a73-410b-9f63-25b3a1c3482b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 204 len: 0 microversion: 2.1 time: 0.421838 Jun 16 19:49:36.568166 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 475/921] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:49:36 2022] DELETE /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:49:36.576072 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7245d4fb-e9af-465f-b962-525f4f127a4c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:36.576682 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7245d4fb-e9af-465f-b962-525f4f127a4c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:36.579796 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=6 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:36.584232 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7245d4fb-e9af-465f-b962-525f4f127a4c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:36.584672 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7245d4fb-e9af-465f-b962-525f4f127a4c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:36.585729 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7245d4fb-e9af-465f-b962-525f4f127a4c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:36.586166 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7245d4fb-e9af-465f-b962-525f4f127a4c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:36.721991 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7245d4fb-e9af-465f-b962-525f4f127a4c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:36.730414 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7245d4fb-e9af-465f-b962-525f4f127a4c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1507 microversion: 2.1 time: 0.158042 Jun 16 19:49:36.730999 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 447/922] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:36 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:36.900502 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3de0290e-a2aa-477b-854f-36b4e1eed9b1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:36.901421 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-3de0290e-a2aa-477b-854f-36b4e1eed9b1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:36.908458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3de0290e-a2aa-477b-854f-36b4e1eed9b1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:36.909322 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3de0290e-a2aa-477b-854f-36b4e1eed9b1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:36.910620 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3de0290e-a2aa-477b-854f-36b4e1eed9b1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:36.911104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3de0290e-a2aa-477b-854f-36b4e1eed9b1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:37.050206 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3de0290e-a2aa-477b-854f-36b4e1eed9b1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:37.060441 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3de0290e-a2aa-477b-854f-36b4e1eed9b1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:37.062186 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3de0290e-a2aa-477b-854f-36b4e1eed9b1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:37.063549 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-3de0290e-a2aa-477b-854f-36b4e1eed9b1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1406 microversion: 2.20 time: 0.167805 Jun 16 19:49:37.074749 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 476/923] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:36 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:37.747009 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c52ad894-9240-4129-867f-2850730fe596 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:37.748309 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c52ad894-9240-4129-867f-2850730fe596 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:37.756009 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c52ad894-9240-4129-867f-2850730fe596 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:37.756730 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c52ad894-9240-4129-867f-2850730fe596 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:37.757505 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c52ad894-9240-4129-867f-2850730fe596 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:37.760778 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c52ad894-9240-4129-867f-2850730fe596 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:37.915447 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c52ad894-9240-4129-867f-2850730fe596 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:37.924038 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c52ad894-9240-4129-867f-2850730fe596 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1507 microversion: 2.1 time: 0.180758 Jun 16 19:49:37.924608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 448/924] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:37 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:38.083985 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1b63bbef-6146-489f-8ef2-6b2c2d721d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:38.086206 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-1b63bbef-6146-489f-8ef2-6b2c2d721d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:38.099543 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1b63bbef-6146-489f-8ef2-6b2c2d721d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:38.100174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1b63bbef-6146-489f-8ef2-6b2c2d721d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:38.101889 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1b63bbef-6146-489f-8ef2-6b2c2d721d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:38.102345 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1b63bbef-6146-489f-8ef2-6b2c2d721d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:38.353392 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1b63bbef-6146-489f-8ef2-6b2c2d721d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:38.361895 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1b63bbef-6146-489f-8ef2-6b2c2d721d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:38.364023 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1b63bbef-6146-489f-8ef2-6b2c2d721d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:38.365130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-1b63bbef-6146-489f-8ef2-6b2c2d721d3d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1406 microversion: 2.20 time: 0.286578 Jun 16 19:49:38.365694 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 477/925] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:38 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:38.943384 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-eb1ce629-8e12-4cea-9650-3b46132152f5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:38.944009 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-eb1ce629-8e12-4cea-9650-3b46132152f5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:38.957564 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eb1ce629-8e12-4cea-9650-3b46132152f5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:38.958355 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eb1ce629-8e12-4cea-9650-3b46132152f5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:38.959517 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eb1ce629-8e12-4cea-9650-3b46132152f5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:38.965824 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eb1ce629-8e12-4cea-9650-3b46132152f5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:39.130021 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-eb1ce629-8e12-4cea-9650-3b46132152f5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:39.137696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-eb1ce629-8e12-4cea-9650-3b46132152f5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1507 microversion: 2.1 time: 0.199854 Jun 16 19:49:39.138405 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 449/926] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:38 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:39.262878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-bcf2a2f4-6bc5-4987-8f53-fe565a0ab1d2 req-562918ce-804d-4d2a-aadb-8c992eb28a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe0ce4c-ef63-4027-aa27-b0d53d1554e0", "name": "network-vif-deleted", "tag": "1ca7b559-06c5-424b-bad3-109e063eafe3"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:39.262878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-bcf2a2f4-6bc5-4987-8f53-fe565a0ab1d2 req-562918ce-804d-4d2a-aadb-8c992eb28a79 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:39.262878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-bcf2a2f4-6bc5-4987-8f53-fe565a0ab1d2 req-562918ce-804d-4d2a-aadb-8c992eb28a79 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:39.275623 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-bcf2a2f4-6bc5-4987-8f53-fe565a0ab1d2 req-562918ce-804d-4d2a-aadb-8c992eb28a79 service nova] Creating event network-vif-deleted:1ca7b559-06c5-424b-bad3-109e063eafe3 for instance dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 on hv-cinder-84617 Jun 16 19:49:39.280840 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-bcf2a2f4-6bc5-4987-8f53-fe565a0ab1d2 req-562918ce-804d-4d2a-aadb-8c992eb28a79 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033337 Jun 16 19:49:39.281844 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 478/927] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:39.383793 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9d3df3db-e6b2-47f0-8350-b092a31936cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:39.384858 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9d3df3db-e6b2-47f0-8350-b092a31936cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:39.391466 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d3df3db-e6b2-47f0-8350-b092a31936cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:39.391951 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d3df3db-e6b2-47f0-8350-b092a31936cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:39.392800 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d3df3db-e6b2-47f0-8350-b092a31936cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:39.393305 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d3df3db-e6b2-47f0-8350-b092a31936cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:39.854867 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9d3df3db-e6b2-47f0-8350-b092a31936cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:39.870373 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9d3df3db-e6b2-47f0-8350-b092a31936cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:39.872466 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9d3df3db-e6b2-47f0-8350-b092a31936cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:39.891676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9d3df3db-e6b2-47f0-8350-b092a31936cd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1406 microversion: 2.20 time: 0.510777 Jun 16 19:49:39.903255 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 450/928] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:39 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1406 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:39.988573 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-91e5b511-9b7e-4569-97fe-f2c80969a401 req-f4676b10-f28d-43c4-be9f-10080d16ab12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "763636a9-34c8-47b8-8f39-fdbc2ff40e23", "name": "network-vif-plugged", "status": "completed", "tag": "6a3e5e5b-38d9-46c6-86d4-f4326eeff1a1"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:40.007092 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-91e5b511-9b7e-4569-97fe-f2c80969a401 req-f4676b10-f28d-43c4-be9f-10080d16ab12 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:40.007799 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-91e5b511-9b7e-4569-97fe-f2c80969a401 req-f4676b10-f28d-43c4-be9f-10080d16ab12 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:40.028452 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-91e5b511-9b7e-4569-97fe-f2c80969a401 req-f4676b10-f28d-43c4-be9f-10080d16ab12 service nova] Creating event network-vif-plugged:6a3e5e5b-38d9-46c6-86d4-f4326eeff1a1 for instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 on hv-cinder-84617 Jun 16 19:49:40.040176 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-91e5b511-9b7e-4569-97fe-f2c80969a401 req-f4676b10-f28d-43c4-be9f-10080d16ab12 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.362929 Jun 16 19:49:40.041374 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 479/929] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:49:40.155268 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c4fd8bb0-8c68-4a3e-9c80-f80c0cbafcdd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:40.156067 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c4fd8bb0-8c68-4a3e-9c80-f80c0cbafcdd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:40.163337 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c4fd8bb0-8c68-4a3e-9c80-f80c0cbafcdd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:40.164259 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c4fd8bb0-8c68-4a3e-9c80-f80c0cbafcdd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:40.165146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c4fd8bb0-8c68-4a3e-9c80-f80c0cbafcdd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:40.165677 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c4fd8bb0-8c68-4a3e-9c80-f80c0cbafcdd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:40.200611 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c4fd8bb0-8c68-4a3e-9c80-f80c0cbafcdd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:40.201325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c4fd8bb0-8c68-4a3e-9c80-f80c0cbafcdd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:40.201780 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-c4fd8bb0-8c68-4a3e-9c80-f80c0cbafcdd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lazy-loading 'fault' on Instance uuid dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:49:40.263224 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c4fd8bb0-8c68-4a3e-9c80-f80c0cbafcdd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:40.273963 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c4fd8bb0-8c68-4a3e-9c80-f80c0cbafcdd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 200 len: 1311 microversion: 2.1 time: 0.122969 Jun 16 19:49:40.295116 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 451/930] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:40 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 1311 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:40.914518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-37f5f9b9-bf50-4833-9168-6289c5c4acd1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:40.916337 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-37f5f9b9-bf50-4833-9168-6289c5c4acd1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:40.926718 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-37f5f9b9-bf50-4833-9168-6289c5c4acd1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:40.928267 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-37f5f9b9-bf50-4833-9168-6289c5c4acd1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:40.937144 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-37f5f9b9-bf50-4833-9168-6289c5c4acd1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:40.937667 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-37f5f9b9-bf50-4833-9168-6289c5c4acd1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:41.095190 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-37f5f9b9-bf50-4833-9168-6289c5c4acd1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:41.109397 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-37f5f9b9-bf50-4833-9168-6289c5c4acd1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:41.110846 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-37f5f9b9-bf50-4833-9168-6289c5c4acd1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:41.119825 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-37f5f9b9-bf50-4833-9168-6289c5c4acd1 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1406 microversion: 2.20 time: 0.212177 Jun 16 19:49:41.121493 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 480/931] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:40 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:41.291215 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-762067f7-6652-44c1-befc-efde6cfe9a51 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:41.291824 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-762067f7-6652-44c1-befc-efde6cfe9a51 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: dbe0ce4c-ef63-4027-aa27-b0d53d1554e0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:41.299597 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-762067f7-6652-44c1-befc-efde6cfe9a51 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:41.300630 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-762067f7-6652-44c1-befc-efde6cfe9a51 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:41.301338 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-762067f7-6652-44c1-befc-efde6cfe9a51 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:41.301829 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-762067f7-6652-44c1-befc-efde6cfe9a51 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:41.316768 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-762067f7-6652-44c1-befc-efde6cfe9a51 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] HTTP exception thrown: Instance dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 could not be found. Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-762067f7-6652-44c1-befc-efde6cfe9a51 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Request method failure captured: Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 HTTP/1.1 Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4f2bJrSUVHDMMTqU2Jad-fuYa-ofXk1y9tRV-Se49xlEwwcbihzp3u5EHqEbpzFBj_5sSZbxubYd39VX764172H-VM9cSazwalfJq36RSCcub4-RnQ89lgkzUX_84lIDug8hDGmNJ1OxRyHEdc235OBU20Fo3EaYIsAMLvUvs-yb6k Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 7153c09b2d0b4805ad0360afb7ecd3ca Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-842795293 Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:49:41.318702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:49:41.320401 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7153c09b2d0b4805ad0360afb7ecd3ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7153c09b2d0b4805ad0360afb7ecd3ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7153c09b2d0b4805ad0360afb7ecd3ca", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7153c09b2d0b4805ad0360afb7ecd3ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:49:41.320401 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-ServerRescueNegativeTestJSON-842795293 Jun 16 19:49:41.320401 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 7153c09b2d0b4805ad0360afb7ecd3ca Jun 16 19:49:41.320401 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-842795293 Jun 16 19:49:41.320401 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-ServerRescueNegativeTestJSON-842795293-project Jun 16 19:49:41.320401 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:49:41.320401 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:49:41.320401 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 2d0d5723417d4b60bc51e47f28d09902 Jun 16 19:49:41.320401 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-ServerRescueNegativeTestJSON-842795293-project Jun 16 19:49:41.320401 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:49:41.320401 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 could not be found. Jun 16 19:49:41.320401 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': 'dbe0ce4c-ef63-4027-aa27-b0d53d1554e0'} Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 could not be found. Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:49:41.321277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:49:41.322711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:49:41.322711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:49:41.322711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:49:41.322711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:49:41.322711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:49:41.322711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:49:41.322711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:49:41.322711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 could not be found. Jun 16 19:49:41.322711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:41.322711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:49:41.322711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:41.322711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:49:41.322711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:49:41.322711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:49:41.322711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:49:41.322711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:49:41.322711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 could not be found. Jun 16 19:49:41.322711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:41.327747 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-762067f7-6652-44c1-befc-efde6cfe9a51 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Returning 404 to user: Instance dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:49:41.327747 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-762067f7-6652-44c1-befc-efde6cfe9a51 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0" status: 404 len: 111 microversion: 2.1 time: 0.033023 Jun 16 19:49:41.327747 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 452/932] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:41 2022] GET /compute/v2.1/servers/dbe0ce4c-ef63-4027-aa27-b0d53d1554e0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:49:41.328570 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bcf52396-1cdb-41b5-94b2-e609d053f6e4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:41.329079 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-bcf52396-1cdb-41b5-94b2-e609d053f6e4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:41.335212 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bcf52396-1cdb-41b5-94b2-e609d053f6e4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:41.335845 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bcf52396-1cdb-41b5-94b2-e609d053f6e4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:41.336689 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bcf52396-1cdb-41b5-94b2-e609d053f6e4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:41.337205 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bcf52396-1cdb-41b5-94b2-e609d053f6e4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:41.368695 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-bcf52396-1cdb-41b5-94b2-e609d053f6e4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Going to try to terminate instance {{(pid=124551) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:49:41.773581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-bcf52396-1cdb-41b5-94b2-e609d053f6e4 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "DELETE /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 204 len: 0 microversion: 2.1 time: 0.448446 Jun 16 19:49:41.777479 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 481/933] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:49:41 2022] DELETE /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 19:49:41.784108 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-375f9d05-f019-41dd-a832-69c5a66e9ee5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:41.784841 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-375f9d05-f019-41dd-a832-69c5a66e9ee5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:41.791694 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-375f9d05-f019-41dd-a832-69c5a66e9ee5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:41.792245 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-375f9d05-f019-41dd-a832-69c5a66e9ee5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:41.793390 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-375f9d05-f019-41dd-a832-69c5a66e9ee5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:41.793899 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-375f9d05-f019-41dd-a832-69c5a66e9ee5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:41.953340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-375f9d05-f019-41dd-a832-69c5a66e9ee5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:41.962423 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-375f9d05-f019-41dd-a832-69c5a66e9ee5 tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.183338 Jun 16 19:49:41.963473 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 453/934] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:41 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:42.141259 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8b3c56cf-101e-4ef4-9200-6bc4eb9a4ec4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:42.142637 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8b3c56cf-101e-4ef4-9200-6bc4eb9a4ec4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:42.149343 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8b3c56cf-101e-4ef4-9200-6bc4eb9a4ec4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:42.149991 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8b3c56cf-101e-4ef4-9200-6bc4eb9a4ec4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:42.150853 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8b3c56cf-101e-4ef4-9200-6bc4eb9a4ec4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:42.151503 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8b3c56cf-101e-4ef4-9200-6bc4eb9a4ec4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:42.292196 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8b3c56cf-101e-4ef4-9200-6bc4eb9a4ec4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:42.300869 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8b3c56cf-101e-4ef4-9200-6bc4eb9a4ec4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:42.302394 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8b3c56cf-101e-4ef4-9200-6bc4eb9a4ec4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:42.303526 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8b3c56cf-101e-4ef4-9200-6bc4eb9a4ec4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1406 microversion: 2.20 time: 0.167215 Jun 16 19:49:42.312495 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 482/935] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:42 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:42.979351 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4deac39b-9e0d-46e6-a4ce-f35e808b978c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:42.983784 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4deac39b-9e0d-46e6-a4ce-f35e808b978c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:42.986805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4deac39b-9e0d-46e6-a4ce-f35e808b978c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:42.987356 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4deac39b-9e0d-46e6-a4ce-f35e808b978c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:42.988745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4deac39b-9e0d-46e6-a4ce-f35e808b978c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:42.989242 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4deac39b-9e0d-46e6-a4ce-f35e808b978c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:43.125250 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4deac39b-9e0d-46e6-a4ce-f35e808b978c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:43.133195 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4deac39b-9e0d-46e6-a4ce-f35e808b978c tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.157734 Jun 16 19:49:43.138995 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 454/936] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:42 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:43.322046 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-cdc4060d-d045-4edd-b6a5-a7c6b20027b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:43.323355 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-cdc4060d-d045-4edd-b6a5-a7c6b20027b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:43.330621 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cdc4060d-d045-4edd-b6a5-a7c6b20027b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:43.332076 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cdc4060d-d045-4edd-b6a5-a7c6b20027b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:43.333158 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cdc4060d-d045-4edd-b6a5-a7c6b20027b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:43.333763 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cdc4060d-d045-4edd-b6a5-a7c6b20027b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:43.481962 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-cdc4060d-d045-4edd-b6a5-a7c6b20027b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:43.490388 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-cdc4060d-d045-4edd-b6a5-a7c6b20027b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:43.492071 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-cdc4060d-d045-4edd-b6a5-a7c6b20027b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:43.493542 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-cdc4060d-d045-4edd-b6a5-a7c6b20027b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1406 microversion: 2.20 time: 0.175414 Jun 16 19:49:43.494352 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 483/937] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:43 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:44.153054 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9462331c-36e2-4f49-ad0e-5b107e11f83b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:44.154168 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9462331c-36e2-4f49-ad0e-5b107e11f83b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:44.161278 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9462331c-36e2-4f49-ad0e-5b107e11f83b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:44.161747 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9462331c-36e2-4f49-ad0e-5b107e11f83b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:44.162508 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9462331c-36e2-4f49-ad0e-5b107e11f83b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:44.163184 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9462331c-36e2-4f49-ad0e-5b107e11f83b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:44.321725 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9462331c-36e2-4f49-ad0e-5b107e11f83b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:44.330101 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9462331c-36e2-4f49-ad0e-5b107e11f83b tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1521 microversion: 2.1 time: 0.180864 Jun 16 19:49:44.330783 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 455/938] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:44 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:44.512110 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1ed62458-e7b8-4a39-b03e-b82e77be1dee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:44.512840 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-1ed62458-e7b8-4a39-b03e-b82e77be1dee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:44.515435 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:44.520435 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1ed62458-e7b8-4a39-b03e-b82e77be1dee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:44.520947 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1ed62458-e7b8-4a39-b03e-b82e77be1dee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:44.521726 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1ed62458-e7b8-4a39-b03e-b82e77be1dee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:44.522166 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1ed62458-e7b8-4a39-b03e-b82e77be1dee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:44.719865 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1ed62458-e7b8-4a39-b03e-b82e77be1dee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:44.730350 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1ed62458-e7b8-4a39-b03e-b82e77be1dee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:44.732227 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1ed62458-e7b8-4a39-b03e-b82e77be1dee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:44.733935 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-1ed62458-e7b8-4a39-b03e-b82e77be1dee tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1598 microversion: 2.20 time: 0.225817 Jun 16 19:49:44.734512 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 484/939] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:49:44 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1598 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:49:44.757399 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-59df1fb1-ad50-4b5c-a253-dbed76160f16 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:44.757903 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-59df1fb1-ad50-4b5c-a253-dbed76160f16 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:44.759774 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:44.768093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-59df1fb1-ad50-4b5c-a253-dbed76160f16 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:44.769346 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-59df1fb1-ad50-4b5c-a253-dbed76160f16 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:44.770495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-59df1fb1-ad50-4b5c-a253-dbed76160f16 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:44.771007 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-59df1fb1-ad50-4b5c-a253-dbed76160f16 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:44.883455 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-59df1fb1-ad50-4b5c-a253-dbed76160f16 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.130407 Jun 16 19:49:44.884168 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 456/940] 10.222.0.36 () {60 vars in 1315 bytes} [Thu Jun 16 19:49:44 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:49:45.348850 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-96d83cb8-7b69-42c4-9e71-18bfe7b3ca7f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:45.349872 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-96d83cb8-7b69-42c4-9e71-18bfe7b3ca7f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:45.371476 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-96d83cb8-7b69-42c4-9e71-18bfe7b3ca7f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:45.371476 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-96d83cb8-7b69-42c4-9e71-18bfe7b3ca7f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:45.371476 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-96d83cb8-7b69-42c4-9e71-18bfe7b3ca7f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:45.371476 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-96d83cb8-7b69-42c4-9e71-18bfe7b3ca7f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:45.430057 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-408f418f-6e33-4efc-ac56-0572259089d5 req-b752589b-d35d-4b58-bdab-9005dbaf6f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f5ae39-c48a-49e8-81b0-5f1ea289f14f", "name": "network-vif-deleted", "tag": "8eabf1a8-e341-4228-bdcf-f29f74159486"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:45.444790 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-408f418f-6e33-4efc-ac56-0572259089d5 req-b752589b-d35d-4b58-bdab-9005dbaf6f03 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:45.445242 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-408f418f-6e33-4efc-ac56-0572259089d5 req-b752589b-d35d-4b58-bdab-9005dbaf6f03 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:45.458685 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-408f418f-6e33-4efc-ac56-0572259089d5 req-b752589b-d35d-4b58-bdab-9005dbaf6f03 service nova] Creating event network-vif-deleted:8eabf1a8-e341-4228-bdcf-f29f74159486 for instance 02f5ae39-c48a-49e8-81b0-5f1ea289f14f on hv-cinder-84617 Jun 16 19:49:45.463909 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-408f418f-6e33-4efc-ac56-0572259089d5 req-b752589b-d35d-4b58-bdab-9005dbaf6f03 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038516 Jun 16 19:49:45.464819 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 457/941] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:45.566043 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-96d83cb8-7b69-42c4-9e71-18bfe7b3ca7f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:45.575171 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-96d83cb8-7b69-42c4-9e71-18bfe7b3ca7f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1479 microversion: 2.1 time: 0.231092 Jun 16 19:49:45.584506 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 485/942] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:45 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1479 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:46.594442 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b4ef9454-414b-429e-b91e-c114b4670b0f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:46.595286 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b4ef9454-414b-429e-b91e-c114b4670b0f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:46.602290 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b4ef9454-414b-429e-b91e-c114b4670b0f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:46.602744 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b4ef9454-414b-429e-b91e-c114b4670b0f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:46.603537 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b4ef9454-414b-429e-b91e-c114b4670b0f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:46.603975 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b4ef9454-414b-429e-b91e-c114b4670b0f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:46.638502 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b4ef9454-414b-429e-b91e-c114b4670b0f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:46.639133 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b4ef9454-414b-429e-b91e-c114b4670b0f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:46.660550 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-b4ef9454-414b-429e-b91e-c114b4670b0f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lazy-loading 'fault' on Instance uuid 02f5ae39-c48a-49e8-81b0-5f1ea289f14f {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:49:46.696319 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b4ef9454-414b-429e-b91e-c114b4670b0f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0d5723417d4b60bc51e47f28d09902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7153c09b2d0b4805ad0360afb7ecd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:49:46.705874 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b4ef9454-414b-429e-b91e-c114b4670b0f tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 200 len: 1311 microversion: 2.1 time: 0.116457 Jun 16 19:49:46.706759 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 458/943] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:46 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 1311 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:49:47.013744 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-e2695b0f-a918-4ae4-a25d-887ad15352db req-6a425aae-b2d4-4f5e-887b-b6d16096935c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "763636a9-34c8-47b8-8f39-fdbc2ff40e23", "tag": "6a3e5e5b-38d9-46c6-86d4-f4326eeff1a1"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:47.024284 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-e2695b0f-a918-4ae4-a25d-887ad15352db req-6a425aae-b2d4-4f5e-887b-b6d16096935c service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:47.028143 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-e2695b0f-a918-4ae4-a25d-887ad15352db req-6a425aae-b2d4-4f5e-887b-b6d16096935c service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:47.044691 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-e2695b0f-a918-4ae4-a25d-887ad15352db req-6a425aae-b2d4-4f5e-887b-b6d16096935c service nova] Creating event network-changed:6a3e5e5b-38d9-46c6-86d4-f4326eeff1a1 for instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 on hv-cinder-84617 Jun 16 19:49:47.051447 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-e2695b0f-a918-4ae4-a25d-887ad15352db req-6a425aae-b2d4-4f5e-887b-b6d16096935c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041502 Jun 16 19:49:47.052739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 486/944] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:47.473500 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fd0b0af5-086d-4aae-9176-4d918d9f4a68 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:47.475636 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fd0b0af5-086d-4aae-9176-4d918d9f4a68 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:47.488951 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd0b0af5-086d-4aae-9176-4d918d9f4a68 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:47.492323 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd0b0af5-086d-4aae-9176-4d918d9f4a68 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:47.493271 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd0b0af5-086d-4aae-9176-4d918d9f4a68 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:47.495829 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd0b0af5-086d-4aae-9176-4d918d9f4a68 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:47.534475 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fd0b0af5-086d-4aae-9176-4d918d9f4a68 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca/ips" status: 200 len: 151 microversion: 2.1 time: 0.066322 Jun 16 19:49:47.535459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 459/945] 10.222.0.36 () {58 vars in 1247 bytes} [Thu Jun 16 19:49:47 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca/ips => generated 151 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:47.724961 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bdeeb800-eaf1-4d47-b988-9b6f65398bfd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:47.725862 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-bdeeb800-eaf1-4d47-b988-9b6f65398bfd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] [instance: 02f5ae39-c48a-49e8-81b0-5f1ea289f14f] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:47.733008 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bdeeb800-eaf1-4d47-b988-9b6f65398bfd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:47.733684 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bdeeb800-eaf1-4d47-b988-9b6f65398bfd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:47.734560 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bdeeb800-eaf1-4d47-b988-9b6f65398bfd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:47.735136 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bdeeb800-eaf1-4d47-b988-9b6f65398bfd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:47.751174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-bdeeb800-eaf1-4d47-b988-9b6f65398bfd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] HTTP exception thrown: Instance 02f5ae39-c48a-49e8-81b0-5f1ea289f14f could not be found. Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bdeeb800-eaf1-4d47-b988-9b6f65398bfd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Request method failure captured: Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f HTTP/1.1 Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4f2bJrSUVHDMMTqU2Jad-fuYa-ofXk1y9tRV-Se49xlEwwcbihzp3u5EHqEbpzFBj_5sSZbxubYd39VX764172H-VM9cSazwalfJq36RSCcub4-RnQ89lgkzUX_84lIDug8hDGmNJ1OxRyHEdc235OBU20Fo3EaYIsAMLvUvs-yb6k Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 7153c09b2d0b4805ad0360afb7ecd3ca Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-842795293 Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:49:47.760739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:49:47.762952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7153c09b2d0b4805ad0360afb7ecd3ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7153c09b2d0b4805ad0360afb7ecd3ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7153c09b2d0b4805ad0360afb7ecd3ca", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7153c09b2d0b4805ad0360afb7ecd3ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:49:47.762952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-ServerRescueNegativeTestJSON-842795293 Jun 16 19:49:47.762952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 7153c09b2d0b4805ad0360afb7ecd3ca Jun 16 19:49:47.762952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-842795293 Jun 16 19:49:47.762952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-ServerRescueNegativeTestJSON-842795293-project Jun 16 19:49:47.762952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:49:47.762952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:49:47.762952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 2d0d5723417d4b60bc51e47f28d09902 Jun 16 19:49:47.762952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-ServerRescueNegativeTestJSON-842795293-project Jun 16 19:49:47.762952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:49:47.762952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance 02f5ae39-c48a-49e8-81b0-5f1ea289f14f could not be found. Jun 16 19:49:47.762952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': '02f5ae39-c48a-49e8-81b0-5f1ea289f14f'} Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02f5ae39-c48a-49e8-81b0-5f1ea289f14f could not be found. Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:49:47.763928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:49:47.765626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:49:47.765626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:49:47.765626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:49:47.765626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:49:47.765626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:49:47.765626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:49:47.765626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:49:47.765626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02f5ae39-c48a-49e8-81b0-5f1ea289f14f could not be found. Jun 16 19:49:47.765626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:49:47.765626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:49:47.765626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:49:47.765626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:49:47.765626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:49:47.765626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:49:47.765626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:49:47.765626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:49:47.765626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02f5ae39-c48a-49e8-81b0-5f1ea289f14f could not be found. Jun 16 19:49:47.765626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:49:47.767395 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bdeeb800-eaf1-4d47-b988-9b6f65398bfd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] Returning 404 to user: Instance 02f5ae39-c48a-49e8-81b0-5f1ea289f14f could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:49:47.767395 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-bdeeb800-eaf1-4d47-b988-9b6f65398bfd tempest-ServerRescueNegativeTestJSON-842795293 tempest-ServerRescueNegativeTestJSON-842795293-project] 10.222.0.36 "GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f" status: 404 len: 111 microversion: 2.1 time: 0.036016 Jun 16 19:49:47.767395 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 487/946] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:49:47 2022] GET /compute/v2.1/servers/02f5ae39-c48a-49e8-81b0-5f1ea289f14f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:49:49.819825 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d82dd70b-5589-474f-8952-1281391d1114 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4928e949-8448-46cf-869e-1ca9a362b92c"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:49.821215 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d82dd70b-5589-474f-8952-1281391d1114 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:49.828258 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d82dd70b-5589-474f-8952-1281391d1114 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:49.828820 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d82dd70b-5589-474f-8952-1281391d1114 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:49.829708 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d82dd70b-5589-474f-8952-1281391d1114 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:49.830193 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d82dd70b-5589-474f-8952-1281391d1114 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:49.982485 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5f32d991-b22d-498b-9515-68c5af6a4684 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1819021918"}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:49.983737 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5f32d991-b22d-498b-9515-68c5af6a4684 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:49.991897 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5f32d991-b22d-498b-9515-68c5af6a4684 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:49.992767 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5f32d991-b22d-498b-9515-68c5af6a4684 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:49.993883 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5f32d991-b22d-498b-9515-68c5af6a4684 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:49.994484 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5f32d991-b22d-498b-9515-68c5af6a4684 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:50.220811 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.network.security_group_api [None req-5f32d991-b22d-498b-9515-68c5af6a4684 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Removing security group d9cf1295-81d8-4630-92bf-3d0ed9b29b14 from port 8b0eb30b-d9a5-4b32-a7b4-cff5a9a46047 Jun 16 19:49:50.909411 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d82dd70b-5589-474f-8952-1281391d1114 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "POST /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.093999 Jun 16 19:49:50.910653 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 460/947] 10.222.0.36 () {60 vars in 1322 bytes} [Thu Jun 16 19:49:49 2022] POST /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca/os-volume_attachments => generated 194 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:51.091918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5f32d991-b22d-498b-9515-68c5af6a4684 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "POST /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/action" status: 202 len: 0 microversion: 2.1 time: 1.113680 Jun 16 19:49:51.092682 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 488/948] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Jun 16 19:49:49 2022] POST /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/action => generated 0 bytes in 1115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:49:51.126487 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-7467c0c4-af4d-4e8d-bc6e-ef071c5ccd22 req-1d78f699-2670-4793-a940-eb54c9711887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf542d63-f9a6-4101-a1a0-be5fff525e1e", "tag": "8b0eb30b-d9a5-4b32-a7b4-cff5a9a46047"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:51.155629 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-7467c0c4-af4d-4e8d-bc6e-ef071c5ccd22 req-1d78f699-2670-4793-a940-eb54c9711887 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:51.158377 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-7467c0c4-af4d-4e8d-bc6e-ef071c5ccd22 req-1d78f699-2670-4793-a940-eb54c9711887 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:51.208229 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-7467c0c4-af4d-4e8d-bc6e-ef071c5ccd22 req-1d78f699-2670-4793-a940-eb54c9711887 service nova] Creating event network-changed:8b0eb30b-d9a5-4b32-a7b4-cff5a9a46047 for instance bf542d63-f9a6-4101-a1a0-be5fff525e1e on hv-cinder-84617 Jun 16 19:49:51.217265 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-7467c0c4-af4d-4e8d-bc6e-ef071c5ccd22 req-1d78f699-2670-4793-a940-eb54c9711887 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101698 Jun 16 19:49:51.225377 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 489/949] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:49:51.256673 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bcf364bc-7731-47c6-a1a9-7df77235588a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Action: 'create', calling method: .version_select at 0x7f0505ccf1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-555335683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrdm+3bSRPo6+yAHgRVCbP/ZKc0/dE3YQ3G1aCRKauuAIzaWKCnhWPrQ3SxmaiPxYl32Om8Mivb6dl+ivazQvd7vZGf2PXjM7jRlhCYzzwQWKWSpmquhbSQKv/yDFhj4w=="}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:51.287692 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-bcf364bc-7731-47c6-a1a9-7df77235588a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Getting quotas for project 6329f898314d44d2b6c264d8224a8c46. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:49:51.298589 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-bcf364bc-7731-47c6-a1a9-7df77235588a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Getting quotas for user ab96fb75e716433f857cb9a4c0d7fb2a and project 6329f898314d44d2b6c264d8224a8c46. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:49:51.494683 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-bcf364bc-7731-47c6-a1a9-7df77235588a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.564799 Jun 16 19:49:51.496073 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 461/950] 10.222.0.36 () {60 vars in 1158 bytes} [Thu Jun 16 19:49:50 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:53.244446 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-ea669955-723b-4a46-a08f-b18d06627173 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:53.245052 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-ea669955-723b-4a46-a08f-b18d06627173 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:53.251819 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ea669955-723b-4a46-a08f-b18d06627173 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:53.252479 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ea669955-723b-4a46-a08f-b18d06627173 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:53.253509 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ea669955-723b-4a46-a08f-b18d06627173 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:53.254169 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ea669955-723b-4a46-a08f-b18d06627173 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:53.260287 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-dcbc5dbc-9796-4ad2-b1d9-d42210f05ebc req-da8cbf19-fcde-4ed8-90ea-1bcdefcc38e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf542d63-f9a6-4101-a1a0-be5fff525e1e", "tag": "8b0eb30b-d9a5-4b32-a7b4-cff5a9a46047"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:53.274159 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-dcbc5dbc-9796-4ad2-b1d9-d42210f05ebc req-da8cbf19-fcde-4ed8-90ea-1bcdefcc38e1 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:53.274610 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-dcbc5dbc-9796-4ad2-b1d9-d42210f05ebc req-da8cbf19-fcde-4ed8-90ea-1bcdefcc38e1 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:53.294166 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-dcbc5dbc-9796-4ad2-b1d9-d42210f05ebc req-da8cbf19-fcde-4ed8-90ea-1bcdefcc38e1 service nova] Creating event network-changed:8b0eb30b-d9a5-4b32-a7b4-cff5a9a46047 for instance bf542d63-f9a6-4101-a1a0-be5fff525e1e on hv-cinder-84617 Jun 16 19:49:53.314227 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-dcbc5dbc-9796-4ad2-b1d9-d42210f05ebc req-da8cbf19-fcde-4ed8-90ea-1bcdefcc38e1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057913 Jun 16 19:49:53.315264 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 462/951] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:53.477650 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-ea669955-723b-4a46-a08f-b18d06627173 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lazy-loading 'services' on Instance uuid bf542d63-f9a6-4101-a1a0-be5fff525e1e {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:49:53.837966 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-ea669955-723b-4a46-a08f-b18d06627173 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments/29503ee7-35a9-4df4-be78-3fa88a36ff26" status: 202 len: 0 microversion: 2.1 time: 0.595471 Jun 16 19:49:53.837966 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 490/952] 10.222.0.36 () {58 vars in 1415 bytes} [Thu Jun 16 19:49:53 2022] DELETE /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments/29503ee7-35a9-4df4-be78-3fa88a36ff26 => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:49:53.844745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3e231c5c-6180-4508-849a-48bd1afae770 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:53.845792 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3e231c5c-6180-4508-849a-48bd1afae770 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:53.861842 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3e231c5c-6180-4508-849a-48bd1afae770 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:53.865291 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3e231c5c-6180-4508-849a-48bd1afae770 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:53.876305 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3e231c5c-6180-4508-849a-48bd1afae770 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:53.876305 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3e231c5c-6180-4508-849a-48bd1afae770 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:53.907256 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3e231c5c-6180-4508-849a-48bd1afae770 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066937 Jun 16 19:49:53.908654 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 463/953] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:49:53 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:54.921462 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-54549b99-eb3b-4fc5-a4ca-c0f84cf17415 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:54.923200 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-54549b99-eb3b-4fc5-a4ca-c0f84cf17415 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:54.931022 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-54549b99-eb3b-4fc5-a4ca-c0f84cf17415 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:54.931479 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-54549b99-eb3b-4fc5-a4ca-c0f84cf17415 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:54.932543 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-54549b99-eb3b-4fc5-a4ca-c0f84cf17415 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:54.933243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-54549b99-eb3b-4fc5-a4ca-c0f84cf17415 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:54.978533 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-54549b99-eb3b-4fc5-a4ca-c0f84cf17415 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061273 Jun 16 19:49:54.983251 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 491/954] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:49:54 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:55.991003 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8d645e1b-f8d0-47bf-ac79-2c39dfb64dc1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:55.992131 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8d645e1b-f8d0-47bf-ac79-2c39dfb64dc1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:55.998880 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8d645e1b-f8d0-47bf-ac79-2c39dfb64dc1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:55.999437 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8d645e1b-f8d0-47bf-ac79-2c39dfb64dc1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:56.000215 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8d645e1b-f8d0-47bf-ac79-2c39dfb64dc1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:56.000653 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8d645e1b-f8d0-47bf-ac79-2c39dfb64dc1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:56.022629 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:56.037015 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8d645e1b-f8d0-47bf-ac79-2c39dfb64dc1 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049917 Jun 16 19:49:56.037594 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 464/955] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:49:55 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:57.048569 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5d732156-122f-4656-80bc-f4c9d0cf75c8 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:57.050033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5d732156-122f-4656-80bc-f4c9d0cf75c8 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:57.056529 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d732156-122f-4656-80bc-f4c9d0cf75c8 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:57.057019 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d732156-122f-4656-80bc-f4c9d0cf75c8 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:57.057752 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d732156-122f-4656-80bc-f4c9d0cf75c8 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:57.058194 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d732156-122f-4656-80bc-f4c9d0cf75c8 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:57.075662 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:49:57.087664 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5d732156-122f-4656-80bc-f4c9d0cf75c8 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043043 Jun 16 19:49:57.088225 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 492/956] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:49:57 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:58.099818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-74df6614-7cb7-4f40-a9d1-e7d1654c4202 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:58.100664 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-74df6614-7cb7-4f40-a9d1-e7d1654c4202 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:58.107782 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74df6614-7cb7-4f40-a9d1-e7d1654c4202 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:58.108268 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74df6614-7cb7-4f40-a9d1-e7d1654c4202 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:58.109030 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74df6614-7cb7-4f40-a9d1-e7d1654c4202 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:58.109465 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74df6614-7cb7-4f40-a9d1-e7d1654c4202 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:58.137946 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-74df6614-7cb7-4f40-a9d1-e7d1654c4202 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042648 Jun 16 19:49:58.138497 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 465/957] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:49:58 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:59.149077 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e49d6cdd-de88-4d74-bfca-ababd119bbc9 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:59.150084 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e49d6cdd-de88-4d74-bfca-ababd119bbc9 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:59.157009 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e49d6cdd-de88-4d74-bfca-ababd119bbc9 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:59.157471 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e49d6cdd-de88-4d74-bfca-ababd119bbc9 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:59.158213 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e49d6cdd-de88-4d74-bfca-ababd119bbc9 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:59.158649 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e49d6cdd-de88-4d74-bfca-ababd119bbc9 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:59.188960 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e49d6cdd-de88-4d74-bfca-ababd119bbc9 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044052 Jun 16 19:49:59.189529 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 493/958] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:49:59 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:49:59.736878 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-204a868a-f5f1-4195-be87-700fad7e0e63 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4928e949-8448-46cf-869e-1ca9a362b92c"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:49:59.738057 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-204a868a-f5f1-4195-be87-700fad7e0e63 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:59.744806 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-204a868a-f5f1-4195-be87-700fad7e0e63 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:59.745484 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-204a868a-f5f1-4195-be87-700fad7e0e63 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:59.746251 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-204a868a-f5f1-4195-be87-700fad7e0e63 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:59.746782 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-204a868a-f5f1-4195-be87-700fad7e0e63 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:59.828100 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-204a868a-f5f1-4195-be87-700fad7e0e63 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] HTTP exception thrown: Invalid volume: volume 4928e949-8448-46cf-869e-1ca9a362b92c is already attached to instances: b5581fbe-6950-4ade-86e0-a1fa41b436ca Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-204a868a-f5f1-4195-be87-700fad7e0e63 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Request method failure captured: Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: POST /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca/os-volume_attachments HTTP/1.1 Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 74 Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4fyBPW6I9Gw6XK8Mc3wtez0zYsc4UrjgW7z4WtApzgBYkrjjskhl3gYkWnE6yWJE5ICrDHXLgUYO-0AGzBAc7qg6XibMR0r_JEUP5LVfGl7WyQCTm5mkF0v4IWKdbz7Ao2NSIM42ZaaFkj5iXJmRir4voVV15buKmDOb_Ti4CHFnHY Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:49:59.829818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:49:59.831933 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47a4ab888dd74218ab5d7812ad095371", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:49:59.831933 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:49:59.831933 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:49:59.831933 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:49:59.831933 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:49:59.831933 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:49:59.831933 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:49:59.831933 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 4df05cbf303c4524a665b429f240a17a Jun 16 19:49:59.831933 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:49:59.831933 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Jun 16 19:49:59.831933 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {"volumeAttachment": {"volumeId": "4928e949-8448-46cf-869e-1ca9a362b92c"}} Jun 16 19:49:59.831933 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:49:59.832739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Invalid volume: volume 4928e949-8448-46cf-869e-1ca9a362b92c is already attached to instances: b5581fbe-6950-4ade-86e0-a1fa41b436ca Jun 16 19:49:59.832739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'server_id': 'b5581fbe-6950-4ade-86e0-a1fa41b436ca', 'body': {'volumeAttachment': {'volumeId': '4928e949-8448-46cf-869e-1ca9a362b92c'}}} Jun 16 19:49:59.832739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:49:59.832739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:49:59.832739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 19:49:59.832739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 19:49:59.832739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 19:49:59.832739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:49:59.832739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 19:49:59.832739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 19:49:59.832739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 19:49:59.832739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 19:49:59.832739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 19:49:59.832739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 19:49:59.832739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4928e949-8448-46cf-869e-1ca9a362b92c is already attached to instances: b5581fbe-6950-4ade-86e0-a1fa41b436ca Jun 16 19:49:59.832739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:59.832739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:49:59.832739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:59.832739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4928e949-8448-46cf-869e-1ca9a362b92c is already attached to instances: b5581fbe-6950-4ade-86e0-a1fa41b436ca Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:49:59.834066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:49:59.840207 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:49:59.840207 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:49:59.840207 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:49:59.840207 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4928e949-8448-46cf-869e-1ca9a362b92c is already attached to instances: b5581fbe-6950-4ade-86e0-a1fa41b436ca Jun 16 19:49:59.840207 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:49:59.840207 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-204a868a-f5f1-4195-be87-700fad7e0e63 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Returning 400 to user: Invalid volume: volume 4928e949-8448-46cf-869e-1ca9a362b92c is already attached to instances: b5581fbe-6950-4ade-86e0-a1fa41b436ca {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:49:59.840207 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-204a868a-f5f1-4195-be87-700fad7e0e63 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "POST /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099164 Jun 16 19:49:59.840207 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 466/959] 10.222.0.36 () {60 vars in 1322 bytes} [Thu Jun 16 19:49:59 2022] POST /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:49:59.896279 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1e4143d8-af27-49ea-8a56-3fa9b08db86b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:49:59.896770 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-1e4143d8-af27-49ea-8a56-3fa9b08db86b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:49:59.902611 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1e4143d8-af27-49ea-8a56-3fa9b08db86b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:59.903095 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1e4143d8-af27-49ea-8a56-3fa9b08db86b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:59.903847 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1e4143d8-af27-49ea-8a56-3fa9b08db86b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:49:59.904277 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1e4143d8-af27-49ea-8a56-3fa9b08db86b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:49:59.987709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-1e4143d8-af27-49ea-8a56-3fa9b08db86b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lazy-loading 'services' on Instance uuid b5581fbe-6950-4ade-86e0-a1fa41b436ca {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:50:00.201373 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-52a1c583-8ffc-41a4-bdac-eea3ec01cdf0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:00.202298 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-52a1c583-8ffc-41a4-bdac-eea3ec01cdf0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:00.209807 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-52a1c583-8ffc-41a4-bdac-eea3ec01cdf0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:00.210255 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-52a1c583-8ffc-41a4-bdac-eea3ec01cdf0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:00.211044 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-52a1c583-8ffc-41a4-bdac-eea3ec01cdf0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:00.211480 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-52a1c583-8ffc-41a4-bdac-eea3ec01cdf0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:00.239221 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-52a1c583-8ffc-41a4-bdac-eea3ec01cdf0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041762 Jun 16 19:50:00.240053 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 467/960] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:50:00 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:50:00.508709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-1e4143d8-af27-49ea-8a56-3fa9b08db86b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca/os-volume_attachments/4928e949-8448-46cf-869e-1ca9a362b92c" status: 202 len: 0 microversion: 2.1 time: 0.616566 Jun 16 19:50:00.512183 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 494/961] 10.222.0.36 () {58 vars in 1415 bytes} [Thu Jun 16 19:49:59 2022] DELETE /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca/os-volume_attachments/4928e949-8448-46cf-869e-1ca9a362b92c => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:50:00.520433 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-60506384-a202-4675-8d47-c2607074dc07 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:00.521737 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-60506384-a202-4675-8d47-c2607074dc07 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:00.528873 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-60506384-a202-4675-8d47-c2607074dc07 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:00.529662 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-60506384-a202-4675-8d47-c2607074dc07 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:00.530593 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-60506384-a202-4675-8d47-c2607074dc07 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:00.531049 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-60506384-a202-4675-8d47-c2607074dc07 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:00.567321 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-60506384-a202-4675-8d47-c2607074dc07 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052181 Jun 16 19:50:00.567891 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 468/962] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:50:00 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:50:01.254000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9b1dfba2-479e-4c07-b7a6-ed27b7acc495 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:01.255584 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9b1dfba2-479e-4c07-b7a6-ed27b7acc495 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:01.262885 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9b1dfba2-479e-4c07-b7a6-ed27b7acc495 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:01.263291 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9b1dfba2-479e-4c07-b7a6-ed27b7acc495 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:01.264052 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9b1dfba2-479e-4c07-b7a6-ed27b7acc495 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:01.264484 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9b1dfba2-479e-4c07-b7a6-ed27b7acc495 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:01.291821 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9b1dfba2-479e-4c07-b7a6-ed27b7acc495 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043976 Jun 16 19:50:01.292366 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 495/963] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:50:01 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:50:01.303132 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-54c34443-47a4-44b4-a811-77f8b90b0d62 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:01.303699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-54c34443-47a4-44b4-a811-77f8b90b0d62 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:01.310668 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54c34443-47a4-44b4-a811-77f8b90b0d62 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:01.311157 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54c34443-47a4-44b4-a811-77f8b90b0d62 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:01.311927 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54c34443-47a4-44b4-a811-77f8b90b0d62 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:01.312384 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54c34443-47a4-44b4-a811-77f8b90b0d62 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:01.315959 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=4 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:50:01.393324 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-54c34443-47a4-44b4-a811-77f8b90b0d62 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] HTTP exception thrown: Instance bf542d63-f9a6-4101-a1a0-be5fff525e1e is not attached to volume 29503ee7-35a9-4df4-be78-3fa88a36ff26 Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-54c34443-47a4-44b4-a811-77f8b90b0d62 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Request method failure captured: Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: DELETE /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments/29503ee7-35a9-4df4-be78-3fa88a36ff26 HTTP/1.1 Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4iM5ODuGNEQdiCjm5g2_UrnlvpAf9QIEpaq4QZOQAlkeiPXSuGjwOhpDkwlMhLF-SQoHXWILEXN9e-I8gKMY_FPjUJZhJ-vXwT7o1lgF0Jb6lDBchJbLck91-gvL1hGjwBog8vIIlemlSXSdzV_9AQspbi3RbI5SBOmcAAjGhM579U Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 2ab754ce6b844222af7ddb23f93aa648 Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-TestMinimumBasicScenario-1552011605 Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:50:01.401380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:50:01.403103 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2ab754ce6b844222af7ddb23f93aa648"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2ab754ce6b844222af7ddb23f93aa648"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2ab754ce6b844222af7ddb23f93aa648", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2ab754ce6b844222af7ddb23f93aa648"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:50:01.403103 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-TestMinimumBasicScenario-1552011605 Jun 16 19:50:01.403103 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 2ab754ce6b844222af7ddb23f93aa648 Jun 16 19:50:01.403103 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1552011605 Jun 16 19:50:01.403103 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-TestMinimumBasicScenario-1552011605-project Jun 16 19:50:01.403103 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:50:01.403103 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:50:01.403103 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 88446ec114864875a88a20d634b4423a Jun 16 19:50:01.403103 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-TestMinimumBasicScenario-1552011605-project Jun 16 19:50:01.403103 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:50:01.403103 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance bf542d63-f9a6-4101-a1a0-be5fff525e1e is not attached to volume 29503ee7-35a9-4df4-be78-3fa88a36ff26 Jun 16 19:50:01.404037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'server_id': 'bf542d63-f9a6-4101-a1a0-be5fff525e1e', 'id': '29503ee7-35a9-4df4-be78-3fa88a36ff26'} Jun 16 19:50:01.404037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:50:01.404037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:50:01.404037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 19:50:01.404037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 19:50:01.404037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 19:50:01.404037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 19:50:01.404037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 19:50:01.404037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 19:50:01.404037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 29503ee7-35a9-4df4-be78-3fa88a36ff26. Jun 16 19:50:01.404037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:50:01.404037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:50:01.404037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:50:01.404037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:50:01.404037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:50:01.404037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:50:01.404037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:50:01.404037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:50:01.404037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:50:01.405394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:50:01.405394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 19:50:01.405394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 19:50:01.405394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf542d63-f9a6-4101-a1a0-be5fff525e1e is not attached to volume 29503ee7-35a9-4df4-be78-3fa88a36ff26 Jun 16 19:50:01.405394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:50:01.405394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:50:01.405394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:50:01.405394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:50:01.405394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:50:01.405394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:50:01.405394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:50:01.405394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:50:01.405394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf542d63-f9a6-4101-a1a0-be5fff525e1e is not attached to volume 29503ee7-35a9-4df4-be78-3fa88a36ff26 Jun 16 19:50:01.405394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:50:01.405394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-54c34443-47a4-44b4-a811-77f8b90b0d62 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Returning 404 to user: Instance bf542d63-f9a6-4101-a1a0-be5fff525e1e is not attached to volume 29503ee7-35a9-4df4-be78-3fa88a36ff26 {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:50:01.406445 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-54c34443-47a4-44b4-a811-77f8b90b0d62 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments/29503ee7-35a9-4df4-be78-3fa88a36ff26" status: 404 len: 154 microversion: 2.1 time: 0.104695 Jun 16 19:50:01.406445 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 469/964] 10.222.0.36 () {58 vars in 1415 bytes} [Thu Jun 16 19:50:01 2022] DELETE /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e/os-volume_attachments/29503ee7-35a9-4df4-be78-3fa88a36ff26 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:50:01.580287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b870991f-14ed-4ae2-b1eb-32ff12eb6801 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:01.581141 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b870991f-14ed-4ae2-b1eb-32ff12eb6801 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:01.593852 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b870991f-14ed-4ae2-b1eb-32ff12eb6801 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:01.593852 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b870991f-14ed-4ae2-b1eb-32ff12eb6801 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:01.593852 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b870991f-14ed-4ae2-b1eb-32ff12eb6801 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:01.593852 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b870991f-14ed-4ae2-b1eb-32ff12eb6801 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:01.623036 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b870991f-14ed-4ae2-b1eb-32ff12eb6801 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047222 Jun 16 19:50:01.624176 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 496/965] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:50:01 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:50:02.635300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4914e690-ce46-4a5f-9d6f-13e5f6d35006 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:02.636288 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4914e690-ce46-4a5f-9d6f-13e5f6d35006 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:02.642811 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4914e690-ce46-4a5f-9d6f-13e5f6d35006 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:02.645470 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4914e690-ce46-4a5f-9d6f-13e5f6d35006 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:02.645470 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4914e690-ce46-4a5f-9d6f-13e5f6d35006 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:02.645470 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4914e690-ce46-4a5f-9d6f-13e5f6d35006 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:02.674541 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4914e690-ce46-4a5f-9d6f-13e5f6d35006 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043608 Jun 16 19:50:02.675111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 470/966] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:50:02 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:50:02.736243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7f3a0129-fd77-44c4-93e4-3034b92c2618 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:02.737316 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-7f3a0129-fd77-44c4-93e4-3034b92c2618 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:02.746782 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7f3a0129-fd77-44c4-93e4-3034b92c2618 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:02.747590 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7f3a0129-fd77-44c4-93e4-3034b92c2618 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:02.748373 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7f3a0129-fd77-44c4-93e4-3034b92c2618 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:02.748987 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7f3a0129-fd77-44c4-93e4-3034b92c2618 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:02.774616 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5005c477-f018-41c5-aecd-cf33060454f0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:02.775263 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5005c477-f018-41c5-aecd-cf33060454f0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:02.779310 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-7f3a0129-fd77-44c4-93e4-3034b92c2618 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Going to try to terminate instance {{(pid=124551) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:50:02.781888 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5005c477-f018-41c5-aecd-cf33060454f0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:02.782545 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5005c477-f018-41c5-aecd-cf33060454f0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:02.783332 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5005c477-f018-41c5-aecd-cf33060454f0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:02.783934 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5005c477-f018-41c5-aecd-cf33060454f0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:02.810141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5005c477-f018-41c5-aecd-cf33060454f0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Going to try to terminate instance {{(pid=124550) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:50:03.349525 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-7f3a0129-fd77-44c4-93e4-3034b92c2618 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 204 len: 0 microversion: 2.1 time: 0.616925 Jun 16 19:50:03.350021 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5005c477-f018-41c5-aecd-cf33060454f0 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 204 len: 0 microversion: 2.1 time: 0.578978 Jun 16 19:50:03.350233 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 497/967] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:50:02 2022] DELETE /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:50:03.350660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 471/968] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:50:02 2022] DELETE /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 19:50:03.367253 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f3aa7397-8f9a-4bd0-b5f7-a6470e61abfd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:03.367564 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5944fd2f-4ee3-470f-89ca-3534cd2d62da tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:03.367951 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f3aa7397-8f9a-4bd0-b5f7-a6470e61abfd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:03.368432 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5944fd2f-4ee3-470f-89ca-3534cd2d62da tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:03.374115 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f3aa7397-8f9a-4bd0-b5f7-a6470e61abfd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:03.374435 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5944fd2f-4ee3-470f-89ca-3534cd2d62da tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:03.374571 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f3aa7397-8f9a-4bd0-b5f7-a6470e61abfd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:03.374881 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5944fd2f-4ee3-470f-89ca-3534cd2d62da tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:03.375343 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f3aa7397-8f9a-4bd0-b5f7-a6470e61abfd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:03.375699 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5944fd2f-4ee3-470f-89ca-3534cd2d62da tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:03.375839 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f3aa7397-8f9a-4bd0-b5f7-a6470e61abfd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:03.376192 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5944fd2f-4ee3-470f-89ca-3534cd2d62da tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:03.511747 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5944fd2f-4ee3-470f-89ca-3534cd2d62da tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:03.511906 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f3aa7397-8f9a-4bd0-b5f7-a6470e61abfd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:03.520143 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f3aa7397-8f9a-4bd0-b5f7-a6470e61abfd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1682 microversion: 2.1 time: 0.157045 Jun 16 19:50:03.520334 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5944fd2f-4ee3-470f-89ca-3534cd2d62da tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1552 microversion: 2.1 time: 0.157050 Jun 16 19:50:03.520730 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 498/969] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:03 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:03.520832 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 472/970] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:03 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:04.537906 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1a5d1d01-89c6-4b0b-9b1d-a80295df2a69 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:04.539454 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1a5d1d01-89c6-4b0b-9b1d-a80295df2a69 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:04.541083 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3e087f52-4a3e-4210-8884-276ca67c0a2d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:04.541745 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-3e087f52-4a3e-4210-8884-276ca67c0a2d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:04.546910 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a5d1d01-89c6-4b0b-9b1d-a80295df2a69 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:04.547488 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a5d1d01-89c6-4b0b-9b1d-a80295df2a69 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:04.548387 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a5d1d01-89c6-4b0b-9b1d-a80295df2a69 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:04.548896 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a5d1d01-89c6-4b0b-9b1d-a80295df2a69 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:04.551030 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3e087f52-4a3e-4210-8884-276ca67c0a2d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:04.551496 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3e087f52-4a3e-4210-8884-276ca67c0a2d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:04.552310 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3e087f52-4a3e-4210-8884-276ca67c0a2d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:04.552781 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3e087f52-4a3e-4210-8884-276ca67c0a2d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:04.685258 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1a5d1d01-89c6-4b0b-9b1d-a80295df2a69 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:04.691555 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3e087f52-4a3e-4210-8884-276ca67c0a2d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:04.699577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1a5d1d01-89c6-4b0b-9b1d-a80295df2a69 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1552 microversion: 2.1 time: 0.165966 Jun 16 19:50:04.699751 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-3e087f52-4a3e-4210-8884-276ca67c0a2d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1682 microversion: 2.1 time: 0.166134 Jun 16 19:50:04.700193 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 473/971] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:04 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:04.700324 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 499/972] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:04 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:05.717139 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1ae9d2d7-20b7-45a5-a175-683d2aff33f2 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:05.717793 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-1ae9d2d7-20b7-45a5-a175-683d2aff33f2 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:05.718636 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-14b2123d-7b47-4a14-991a-f2c1602bf5fd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:05.719285 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-14b2123d-7b47-4a14-991a-f2c1602bf5fd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:05.724320 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1ae9d2d7-20b7-45a5-a175-683d2aff33f2 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:05.724767 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1ae9d2d7-20b7-45a5-a175-683d2aff33f2 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:05.725523 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1ae9d2d7-20b7-45a5-a175-683d2aff33f2 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:05.725956 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1ae9d2d7-20b7-45a5-a175-683d2aff33f2 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:05.726058 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-14b2123d-7b47-4a14-991a-f2c1602bf5fd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:05.726399 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-14b2123d-7b47-4a14-991a-f2c1602bf5fd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:05.727182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-14b2123d-7b47-4a14-991a-f2c1602bf5fd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:05.727616 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-14b2123d-7b47-4a14-991a-f2c1602bf5fd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:05.872845 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-14b2123d-7b47-4a14-991a-f2c1602bf5fd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:05.881233 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-14b2123d-7b47-4a14-991a-f2c1602bf5fd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1682 microversion: 2.1 time: 0.166431 Jun 16 19:50:05.881932 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 474/973] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:05 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:50:05.889307 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1ae9d2d7-20b7-45a5-a175-683d2aff33f2 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:05.897977 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-1ae9d2d7-20b7-45a5-a175-683d2aff33f2 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1552 microversion: 2.1 time: 0.184978 Jun 16 19:50:05.898981 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 500/974] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:05 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1552 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:06.898311 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9448eb0d-4d8e-4c9c-811a-e827ec694548 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:06.899363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9448eb0d-4d8e-4c9c-811a-e827ec694548 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:06.913528 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9448eb0d-4d8e-4c9c-811a-e827ec694548 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:06.913976 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9448eb0d-4d8e-4c9c-811a-e827ec694548 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:06.914676 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-fd62eae7-42e5-4135-a21a-a38f379f4998 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:06.915197 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9448eb0d-4d8e-4c9c-811a-e827ec694548 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:06.915197 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9448eb0d-4d8e-4c9c-811a-e827ec694548 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:06.915385 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-fd62eae7-42e5-4135-a21a-a38f379f4998 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:06.922495 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fd62eae7-42e5-4135-a21a-a38f379f4998 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:06.922987 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fd62eae7-42e5-4135-a21a-a38f379f4998 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:06.923951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fd62eae7-42e5-4135-a21a-a38f379f4998 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:06.924389 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fd62eae7-42e5-4135-a21a-a38f379f4998 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:07.218584 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9448eb0d-4d8e-4c9c-811a-e827ec694548 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:07.219851 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-fd62eae7-42e5-4135-a21a-a38f379f4998 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:07.230487 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-fd62eae7-42e5-4135-a21a-a38f379f4998 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1552 microversion: 2.1 time: 0.319962 Jun 16 19:50:07.231575 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 501/975] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:06 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1552 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:50:07.249814 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9448eb0d-4d8e-4c9c-811a-e827ec694548 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1682 microversion: 2.1 time: 0.342047 Jun 16 19:50:07.251003 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 475/976] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:06 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1682 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:07.698391 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-f251851e-93bc-4bea-9433-8b7d4ce82973 req-7a5a2a7b-03f3-437a-875b-83a6029dbf2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf542d63-f9a6-4101-a1a0-be5fff525e1e", "name": "network-vif-deleted", "tag": "8b0eb30b-d9a5-4b32-a7b4-cff5a9a46047"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:50:07.708126 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-f251851e-93bc-4bea-9433-8b7d4ce82973 req-7a5a2a7b-03f3-437a-875b-83a6029dbf2d service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:07.708677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-f251851e-93bc-4bea-9433-8b7d4ce82973 req-7a5a2a7b-03f3-437a-875b-83a6029dbf2d service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:07.721282 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-f251851e-93bc-4bea-9433-8b7d4ce82973 req-7a5a2a7b-03f3-437a-875b-83a6029dbf2d service nova] Creating event network-vif-deleted:8b0eb30b-d9a5-4b32-a7b4-cff5a9a46047 for instance bf542d63-f9a6-4101-a1a0-be5fff525e1e on hv-cinder-84617 Jun 16 19:50:07.726358 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-f251851e-93bc-4bea-9433-8b7d4ce82973 req-7a5a2a7b-03f3-437a-875b-83a6029dbf2d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036438 Jun 16 19:50:07.727625 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 502/977] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:50:08.248911 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1a934941-f1aa-444b-83c7-ab5734d382d5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:08.249350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1a934941-f1aa-444b-83c7-ab5734d382d5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:08.258001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a934941-f1aa-444b-83c7-ab5734d382d5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:08.258712 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a934941-f1aa-444b-83c7-ab5734d382d5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:08.259701 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a934941-f1aa-444b-83c7-ab5734d382d5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:08.260145 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a934941-f1aa-444b-83c7-ab5734d382d5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:08.281167 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-081fee12-e885-47f7-a61f-d2bd984aaa84 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:08.282416 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-081fee12-e885-47f7-a61f-d2bd984aaa84 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:08.300878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-081fee12-e885-47f7-a61f-d2bd984aaa84 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:08.301425 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-081fee12-e885-47f7-a61f-d2bd984aaa84 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:08.302128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-081fee12-e885-47f7-a61f-d2bd984aaa84 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:08.302575 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-081fee12-e885-47f7-a61f-d2bd984aaa84 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:08.313476 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a934941-f1aa-444b-83c7-ab5734d382d5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:08.313931 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a934941-f1aa-444b-83c7-ab5734d382d5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:08.314656 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-1a934941-f1aa-444b-83c7-ab5734d382d5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lazy-loading 'fault' on Instance uuid bf542d63-f9a6-4101-a1a0-be5fff525e1e {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:50:08.362056 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1a934941-f1aa-444b-83c7-ab5734d382d5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88446ec114864875a88a20d634b4423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab754ce6b844222af7ddb23f93aa648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:08.371315 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1a934941-f1aa-444b-83c7-ab5734d382d5 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 200 len: 1346 microversion: 2.1 time: 0.126760 Jun 16 19:50:08.372300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 476/978] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:08 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 1346 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:08.377606 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-a4fc586f-e9f1-4a91-b955-c735e0203ff9 req-6a1b04d9-31f2-4876-9020-f225fcef4052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5581fbe-6950-4ade-86e0-a1fa41b436ca", "name": "network-vif-deleted", "tag": "d9b6745f-75a1-4699-a761-dbf5ba2f0465"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:50:08.385590 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-a4fc586f-e9f1-4a91-b955-c735e0203ff9 req-6a1b04d9-31f2-4876-9020-f225fcef4052 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:08.386028 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-a4fc586f-e9f1-4a91-b955-c735e0203ff9 req-6a1b04d9-31f2-4876-9020-f225fcef4052 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:08.388605 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-081fee12-e885-47f7-a61f-d2bd984aaa84 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:08.397904 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-a4fc586f-e9f1-4a91-b955-c735e0203ff9 req-6a1b04d9-31f2-4876-9020-f225fcef4052 service nova] Creating event network-vif-deleted:d9b6745f-75a1-4699-a761-dbf5ba2f0465 for instance b5581fbe-6950-4ade-86e0-a1fa41b436ca on hv-cinder-84617 Jun 16 19:50:08.400716 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-081fee12-e885-47f7-a61f-d2bd984aaa84 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1614 microversion: 2.1 time: 0.134548 Jun 16 19:50:08.401296 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 503/979] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:08 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1614 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:08.403332 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-a4fc586f-e9f1-4a91-b955-c735e0203ff9 req-6a1b04d9-31f2-4876-9020-f225fcef4052 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029821 Jun 16 19:50:08.404080 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 477/980] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:50:09.388518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1a7e89d2-1465-4e5e-9ccf-d1cfd27dbbe9 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:09.389212 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-1a7e89d2-1465-4e5e-9ccf-d1cfd27dbbe9 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] [instance: bf542d63-f9a6-4101-a1a0-be5fff525e1e] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:09.398116 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1a7e89d2-1465-4e5e-9ccf-d1cfd27dbbe9 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:09.398571 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1a7e89d2-1465-4e5e-9ccf-d1cfd27dbbe9 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:09.399469 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1a7e89d2-1465-4e5e-9ccf-d1cfd27dbbe9 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:09.399928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1a7e89d2-1465-4e5e-9ccf-d1cfd27dbbe9 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:09.414442 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-1a7e89d2-1465-4e5e-9ccf-d1cfd27dbbe9 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] HTTP exception thrown: Instance bf542d63-f9a6-4101-a1a0-be5fff525e1e could not be found. Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1a7e89d2-1465-4e5e-9ccf-d1cfd27dbbe9 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Request method failure captured: Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e HTTP/1.1 Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4iM5ODuGNEQdiCjm5g2_UrnlvpAf9QIEpaq4QZOQAlkeiPXSuGjwOhpDkwlMhLF-SQoHXWILEXN9e-I8gKMY_FPjUJZhJ-vXwT7o1lgF0Jb6lDBchJbLck91-gvL1hGjwBog8vIIlemlSXSdzV_9AQspbi3RbI5SBOmcAAjGhM579U Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 2ab754ce6b844222af7ddb23f93aa648 Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-TestMinimumBasicScenario-1552011605 Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:50:09.419346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:50:09.420747 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2ab754ce6b844222af7ddb23f93aa648"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2ab754ce6b844222af7ddb23f93aa648"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2ab754ce6b844222af7ddb23f93aa648", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2ab754ce6b844222af7ddb23f93aa648"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:50:09.420747 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-TestMinimumBasicScenario-1552011605 Jun 16 19:50:09.420747 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 2ab754ce6b844222af7ddb23f93aa648 Jun 16 19:50:09.420747 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1552011605 Jun 16 19:50:09.420747 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-TestMinimumBasicScenario-1552011605-project Jun 16 19:50:09.420747 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:50:09.420747 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:50:09.420747 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 88446ec114864875a88a20d634b4423a Jun 16 19:50:09.420747 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-TestMinimumBasicScenario-1552011605-project Jun 16 19:50:09.420747 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:50:09.420747 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance bf542d63-f9a6-4101-a1a0-be5fff525e1e could not be found. Jun 16 19:50:09.420747 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': 'bf542d63-f9a6-4101-a1a0-be5fff525e1e'} Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf542d63-f9a6-4101-a1a0-be5fff525e1e could not be found. Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:50:09.421585 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:50:09.422907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:50:09.422907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:50:09.422907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:50:09.422907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:50:09.422907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:50:09.422907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:50:09.422907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:50:09.422907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf542d63-f9a6-4101-a1a0-be5fff525e1e could not be found. Jun 16 19:50:09.422907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:50:09.422907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:50:09.422907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:50:09.422907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:50:09.422907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:50:09.422907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:50:09.422907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:50:09.422907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:50:09.422907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf542d63-f9a6-4101-a1a0-be5fff525e1e could not be found. Jun 16 19:50:09.422907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:50:09.424638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1a7e89d2-1465-4e5e-9ccf-d1cfd27dbbe9 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Returning 404 to user: Instance bf542d63-f9a6-4101-a1a0-be5fff525e1e could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:50:09.424638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-1a7e89d2-1465-4e5e-9ccf-d1cfd27dbbe9 tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e" status: 404 len: 111 microversion: 2.1 time: 0.036010 Jun 16 19:50:09.424638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 504/981] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:09 2022] GET /compute/v2.1/servers/bf542d63-f9a6-4101-a1a0-be5fff525e1e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:50:09.424874 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-36a00e39-7df6-4fbb-807a-59d500143cb5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:09.424874 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-36a00e39-7df6-4fbb-807a-59d500143cb5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:09.429936 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-aac358cc-be4f-4eeb-a776-6f15bb32636f tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] Calling method '.version_select at 0x7f050123f280>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:09.435246 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-36a00e39-7df6-4fbb-807a-59d500143cb5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:09.435910 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-36a00e39-7df6-4fbb-807a-59d500143cb5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:09.436920 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-36a00e39-7df6-4fbb-807a-59d500143cb5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:09.437627 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-36a00e39-7df6-4fbb-807a-59d500143cb5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:09.472416 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-36a00e39-7df6-4fbb-807a-59d500143cb5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:09.472870 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-36a00e39-7df6-4fbb-807a-59d500143cb5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:09.473318 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-36a00e39-7df6-4fbb-807a-59d500143cb5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lazy-loading 'fault' on Instance uuid b5581fbe-6950-4ade-86e0-a1fa41b436ca {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:50:09.515410 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-36a00e39-7df6-4fbb-807a-59d500143cb5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:09.523675 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-36a00e39-7df6-4fbb-807a-59d500143cb5 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 200 len: 1330 microversion: 2.1 time: 0.108983 Jun 16 19:50:09.524256 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 478/982] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:09 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 1330 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:09.595834 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-aac358cc-be4f-4eeb-a776-6f15bb32636f tempest-TestMinimumBasicScenario-1552011605 tempest-TestMinimumBasicScenario-1552011605-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-463263915" status: 202 len: 0 microversion: 2.1 time: 0.169930 Jun 16 19:50:09.596421 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 505/983] 10.222.0.36 () {58 vars in 1268 bytes} [Thu Jun 16 19:50:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-463263915 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:50:10.540871 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-406a757a-d710-466b-a989-1b451f26b06f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:10.542111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-406a757a-d710-466b-a989-1b451f26b06f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:10.548638 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-406a757a-d710-466b-a989-1b451f26b06f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:10.549091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-406a757a-d710-466b-a989-1b451f26b06f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:10.549857 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-406a757a-d710-466b-a989-1b451f26b06f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:10.550291 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-406a757a-d710-466b-a989-1b451f26b06f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:10.563804 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-406a757a-d710-466b-a989-1b451f26b06f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] HTTP exception thrown: Instance b5581fbe-6950-4ade-86e0-a1fa41b436ca could not be found. Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-406a757a-d710-466b-a989-1b451f26b06f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Request method failure captured: Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca HTTP/1.1 Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4fyBPW6I9Gw6XK8Mc3wtez0zYsc4UrjgW7z4WtApzgBYkrjjskhl3gYkWnE6yWJE5ICrDHXLgUYO-0AGzBAc7qg6XibMR0r_JEUP5LVfGl7WyQCTm5mkF0v4IWKdbz7Ao2NSIM42ZaaFkj5iXJmRir4voVV15buKmDOb_Ti4CHFnHY Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:50:10.565538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:50:10.567490 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47a4ab888dd74218ab5d7812ad095371", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:50:10.567490 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:50:10.567490 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:50:10.567490 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:50:10.567490 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:50:10.567490 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:50:10.567490 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:50:10.567490 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 4df05cbf303c4524a665b429f240a17a Jun 16 19:50:10.567490 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:50:10.567490 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:50:10.567490 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance b5581fbe-6950-4ade-86e0-a1fa41b436ca could not be found. Jun 16 19:50:10.567490 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': 'b5581fbe-6950-4ade-86e0-a1fa41b436ca'} Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5581fbe-6950-4ade-86e0-a1fa41b436ca could not be found. Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:50:10.568394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:50:10.570139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:50:10.570139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:50:10.570139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:50:10.570139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:50:10.570139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:50:10.570139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:50:10.570139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:50:10.570139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5581fbe-6950-4ade-86e0-a1fa41b436ca could not be found. Jun 16 19:50:10.570139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:50:10.570139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:50:10.570139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:50:10.570139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:50:10.570139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:50:10.570139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:50:10.570139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:50:10.570139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:50:10.570139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5581fbe-6950-4ade-86e0-a1fa41b436ca could not be found. Jun 16 19:50:10.570139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:50:10.573743 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-406a757a-d710-466b-a989-1b451f26b06f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Returning 404 to user: Instance b5581fbe-6950-4ade-86e0-a1fa41b436ca could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:50:10.573743 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-406a757a-d710-466b-a989-1b451f26b06f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 404 len: 111 microversion: 2.1 time: 0.030028 Jun 16 19:50:10.573743 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 479/984] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:10 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:50:10.576742 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c4262427-2e43-4ef2-a3bf-61aeea5c17e6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '.version_select at 0x7f05015c1430>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:10.704331 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c4262427-2e43-4ef2-a3bf-61aeea5c17e6 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-976718056" status: 202 len: 0 microversion: 2.1 time: 0.131874 Jun 16 19:50:10.705792 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 506/985] 10.222.0.36 () {58 vars in 1217 bytes} [Thu Jun 16 19:50:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-976718056 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:50:11.639513 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-02e61616-6390-495a-9855-8b69cfbe669f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Action: 'create', calling method: .version_select at 0x7f0505cd6430>, body: {"keypair": {"name": "tempest-keypair-1767771537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6eQUjGJ8ZAEZnLN+hleBV0A09FZ+/Ge4G9zFa4EK/O3ExKitKOYkFKapbVGLnivGQG/RrPChviQw6yZ/oaVXGz84X1KDHyvtSBUez3NJNoNWuZd/5uZ593Z5XDXRW6nw=="}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:50:11.654167 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-02e61616-6390-495a-9855-8b69cfbe669f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Getting quotas for project 47a4ab888dd74218ab5d7812ad095371. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:50:11.658027 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-02e61616-6390-495a-9855-8b69cfbe669f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Getting quotas for user 4df05cbf303c4524a665b429f240a17a and project 47a4ab888dd74218ab5d7812ad095371. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:50:11.773142 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-02e61616-6390-495a-9855-8b69cfbe669f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.137624 Jun 16 19:50:11.773651 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 480/986] 10.222.0.36 () {60 vars in 1158 bytes} [Thu Jun 16 19:50:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:50:13.441009 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-340a1282-8c0f-4f32-9c42-8f117e049b0b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1634995634", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-555335683", "security_groups": [{"name": "tempest-secgroup-smoke-800164463"}], "networks": [{"uuid": "e951da4a-bd98-4a8b-a564-5e76ea84a3d5"}], "block_device_mapping_v2": [{"uuid": "2d7a29e2-4443-482d-9da0-259f35c1d886", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:50:13.623177 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.network.neutron [None req-340a1282-8c0f-4f32-9c42-8f117e049b0b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] validate_networks() for [('e951da4a-bd98-4a8b-a564-5e76ea84a3d5', None, None, None, None, None)] {{(pid=124551) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:50:14.069320 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-340a1282-8c0f-4f32-9c42-8f117e049b0b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Flavor limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:50:14.069942 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-340a1282-8c0f-4f32-9c42-8f117e049b0b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Image limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:50:14.070781 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-340a1282-8c0f-4f32-9c42-8f117e049b0b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Flavor pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:50:14.071411 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-340a1282-8c0f-4f32-9c42-8f117e049b0b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Image pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:50:14.071857 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-340a1282-8c0f-4f32-9c42-8f117e049b0b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:50:14.081520 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-340a1282-8c0f-4f32-9c42-8f117e049b0b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:14.081971 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-340a1282-8c0f-4f32-9c42-8f117e049b0b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:14.083081 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-340a1282-8c0f-4f32-9c42-8f117e049b0b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:14.083586 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-340a1282-8c0f-4f32-9c42-8f117e049b0b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:14.105163 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-340a1282-8c0f-4f32-9c42-8f117e049b0b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Getting quotas for project 6329f898314d44d2b6c264d8224a8c46. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:50:14.109675 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-340a1282-8c0f-4f32-9c42-8f117e049b0b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Getting quotas for user ab96fb75e716433f857cb9a4c0d7fb2a and project 6329f898314d44d2b6c264d8224a8c46. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:50:14.181159 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-340a1282-8c0f-4f32-9c42-8f117e049b0b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Going to run 1 instances... {{(pid=124551) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:50:14.186179 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-340a1282-8c0f-4f32-9c42-8f117e049b0b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2d7a29e2-4443-482d-9da0-259f35c1d886',volume_size=None,volume_type=None)] {{(pid=124551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:50:15.014528 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-340a1282-8c0f-4f32-9c42-8f117e049b0b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.579058 Jun 16 19:50:15.015630 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 507/987] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:50:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:50:15.027478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f1c41d0d-90c7-400c-a368-a1be911eff34 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:15.030838 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f1c41d0d-90c7-400c-a368-a1be911eff34 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:15.120163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f1c41d0d-90c7-400c-a368-a1be911eff34 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:15.128069 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f1c41d0d-90c7-400c-a368-a1be911eff34 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1088 microversion: 2.1 time: 0.106230 Jun 16 19:50:15.128717 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 481/988] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:15 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1088 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:16.086194 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-348c32ff-0500-4faa-b420-2878229e9ebc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-668661126", "imageRef": "9fcb2be6-02db-4853-a8d6-6478a75f26a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "521c8502-275d-4cd0-b45c-aec01d2fbcf4"}], "security_groups": [{"name": "tempest-securitygroup--1624577085"}], "key_name": "tempest-keypair-1767771537", "user_data": "}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:50:16.145323 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2cdc93b5-80ba-4ff5-9efb-df644762bc9c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:16.146520 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2cdc93b5-80ba-4ff5-9efb-df644762bc9c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:16.211536 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.network.neutron [None req-348c32ff-0500-4faa-b420-2878229e9ebc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] validate_networks() for [('521c8502-275d-4cd0-b45c-aec01d2fbcf4', None, None, None, None, None)] {{(pid=124551) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:50:16.214182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2cdc93b5-80ba-4ff5-9efb-df644762bc9c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:16.222875 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2cdc93b5-80ba-4ff5-9efb-df644762bc9c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1088 microversion: 2.1 time: 0.080885 Jun 16 19:50:16.232202 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 482/989] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:16 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1088 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:50:16.775866 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-348c32ff-0500-4faa-b420-2878229e9ebc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Flavor limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:50:16.776294 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-348c32ff-0500-4faa-b420-2878229e9ebc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Image limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:50:16.776776 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-348c32ff-0500-4faa-b420-2878229e9ebc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Flavor pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:50:16.777187 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-348c32ff-0500-4faa-b420-2878229e9ebc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Image pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:50:16.777633 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-348c32ff-0500-4faa-b420-2878229e9ebc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:50:16.786347 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-348c32ff-0500-4faa-b420-2878229e9ebc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:16.786796 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-348c32ff-0500-4faa-b420-2878229e9ebc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:16.787624 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-348c32ff-0500-4faa-b420-2878229e9ebc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:16.788070 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-348c32ff-0500-4faa-b420-2878229e9ebc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:16.804305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-348c32ff-0500-4faa-b420-2878229e9ebc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Getting quotas for project 47a4ab888dd74218ab5d7812ad095371. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:50:16.807934 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-348c32ff-0500-4faa-b420-2878229e9ebc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Getting quotas for user 4df05cbf303c4524a665b429f240a17a and project 47a4ab888dd74218ab5d7812ad095371. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:50:16.819414 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-348c32ff-0500-4faa-b420-2878229e9ebc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Going to run 1 instances... {{(pid=124551) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:50:16.821512 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-348c32ff-0500-4faa-b420-2878229e9ebc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcb2be6-02db-4853-a8d6-6478a75f26a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:50:17.082156 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-348c32ff-0500-4faa-b420-2878229e9ebc tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.000689 Jun 16 19:50:17.083545 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 508/990] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:50:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 19:50:17.103915 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0a524d60-d509-41a2-85bd-b36f635daa89 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:17.104621 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0a524d60-d509-41a2-85bd-b36f635daa89 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:17.199959 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0a524d60-d509-41a2-85bd-b36f635daa89 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:17.208339 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0a524d60-d509-41a2-85bd-b36f635daa89 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 200 len: 1241 microversion: 2.1 time: 0.111139 Jun 16 19:50:17.220131 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 483/991] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:17 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:17.241520 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5c1d6b35-1a5a-4f25-83db-350cfd28a8f0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:17.242223 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5c1d6b35-1a5a-4f25-83db-350cfd28a8f0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:17.252565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5c1d6b35-1a5a-4f25-83db-350cfd28a8f0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:17.253110 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5c1d6b35-1a5a-4f25-83db-350cfd28a8f0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:17.253957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5c1d6b35-1a5a-4f25-83db-350cfd28a8f0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:17.254644 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5c1d6b35-1a5a-4f25-83db-350cfd28a8f0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:17.332562 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5c1d6b35-1a5a-4f25-83db-350cfd28a8f0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:17.340996 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5c1d6b35-1a5a-4f25-83db-350cfd28a8f0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1130 microversion: 2.1 time: 0.104963 Jun 16 19:50:17.341557 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 509/992] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:17 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1130 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:18.226311 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ba21d47d-142f-4550-bda8-8f48bf5ba3cf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:18.227542 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ba21d47d-142f-4550-bda8-8f48bf5ba3cf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:18.312019 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ba21d47d-142f-4550-bda8-8f48bf5ba3cf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:18.321398 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ba21d47d-142f-4550-bda8-8f48bf5ba3cf tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 200 len: 1241 microversion: 2.1 time: 0.098996 Jun 16 19:50:18.322691 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 484/993] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:18 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:18.367651 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5d8b1b5f-773e-4fbb-9635-6e6eda33f483 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:18.368500 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5d8b1b5f-773e-4fbb-9635-6e6eda33f483 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:18.375442 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d8b1b5f-773e-4fbb-9635-6e6eda33f483 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:18.375888 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d8b1b5f-773e-4fbb-9635-6e6eda33f483 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:18.377199 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d8b1b5f-773e-4fbb-9635-6e6eda33f483 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:18.377633 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5d8b1b5f-773e-4fbb-9635-6e6eda33f483 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:18.458376 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5d8b1b5f-773e-4fbb-9635-6e6eda33f483 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:18.466626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5d8b1b5f-773e-4fbb-9635-6e6eda33f483 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1186 microversion: 2.1 time: 0.102737 Jun 16 19:50:18.467357 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 510/994] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:18 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1186 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:19.339154 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-69f83b80-da34-4e00-8614-1e213bfd9edd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:19.339854 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-69f83b80-da34-4e00-8614-1e213bfd9edd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:19.353246 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-69f83b80-da34-4e00-8614-1e213bfd9edd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:19.362410 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-69f83b80-da34-4e00-8614-1e213bfd9edd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:19.363367 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-69f83b80-da34-4e00-8614-1e213bfd9edd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:19.363880 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-69f83b80-da34-4e00-8614-1e213bfd9edd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:19.368550 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:50:19.449113 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-69f83b80-da34-4e00-8614-1e213bfd9edd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:19.457789 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-69f83b80-da34-4e00-8614-1e213bfd9edd tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 200 len: 1245 microversion: 2.1 time: 0.122774 Jun 16 19:50:19.458448 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 485/995] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:19 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 1245 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:19.484523 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-dc9a5b2d-642b-4576-b761-6164fdd03a31 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:19.485252 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-dc9a5b2d-642b-4576-b761-6164fdd03a31 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:19.492132 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-dc9a5b2d-642b-4576-b761-6164fdd03a31 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:19.492581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-dc9a5b2d-642b-4576-b761-6164fdd03a31 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:19.496474 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-dc9a5b2d-642b-4576-b761-6164fdd03a31 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:19.496474 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-dc9a5b2d-642b-4576-b761-6164fdd03a31 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:19.514629 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:50:19.572614 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-dc9a5b2d-642b-4576-b761-6164fdd03a31 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:19.588386 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-dc9a5b2d-642b-4576-b761-6164fdd03a31 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1204 microversion: 2.1 time: 0.108112 Jun 16 19:50:19.600033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 511/996] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:19 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1204 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:20.474558 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3681bd92-6988-4771-8917-55904e9185b9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:20.475863 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3681bd92-6988-4771-8917-55904e9185b9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:20.481697 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:50:20.485665 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3681bd92-6988-4771-8917-55904e9185b9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:20.485665 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3681bd92-6988-4771-8917-55904e9185b9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:20.485665 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3681bd92-6988-4771-8917-55904e9185b9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:20.485665 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3681bd92-6988-4771-8917-55904e9185b9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:20.593251 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3681bd92-6988-4771-8917-55904e9185b9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:20.604702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3681bd92-6988-4771-8917-55904e9185b9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 200 len: 1293 microversion: 2.1 time: 0.131418 Jun 16 19:50:20.608002 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 486/997] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:20 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 1293 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:20.612927 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-4f29c3e6-69de-4952-843d-8d50d4196311 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:20.614383 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-4f29c3e6-69de-4952-843d-8d50d4196311 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:20.633956 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4f29c3e6-69de-4952-843d-8d50d4196311 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:20.637607 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4f29c3e6-69de-4952-843d-8d50d4196311 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:20.640628 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4f29c3e6-69de-4952-843d-8d50d4196311 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:20.641300 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4f29c3e6-69de-4952-843d-8d50d4196311 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:21.113480 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-4f29c3e6-69de-4952-843d-8d50d4196311 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:21.123394 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-4f29c3e6-69de-4952-843d-8d50d4196311 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1271 microversion: 2.1 time: 0.516199 Jun 16 19:50:21.128694 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 512/998] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:20 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1271 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:50:21.624204 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2bc80822-ea34-4a1d-83a1-5899a3b0091e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:21.624921 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2bc80822-ea34-4a1d-83a1-5899a3b0091e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:21.632180 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2bc80822-ea34-4a1d-83a1-5899a3b0091e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:21.632721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2bc80822-ea34-4a1d-83a1-5899a3b0091e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:21.633555 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2bc80822-ea34-4a1d-83a1-5899a3b0091e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:21.634055 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2bc80822-ea34-4a1d-83a1-5899a3b0091e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:21.991959 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2bc80822-ea34-4a1d-83a1-5899a3b0091e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:22.000337 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2bc80822-ea34-4a1d-83a1-5899a3b0091e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 200 len: 1311 microversion: 2.1 time: 0.379833 Jun 16 19:50:22.000932 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 487/999] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:21 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 1311 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:22.016013 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-553f0fe4-3f9b-4fb3-8d51-f0886fe04c4d req-16069bf0-aa68-49df-820b-cd6b3e4dba70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b0caba3-ed91-4ea7-a868-4f38cc779fc1", "tag": "92634527-2839-4585-b57d-a54684637b9f"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:50:22.028792 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:50:22.031752 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-553f0fe4-3f9b-4fb3-8d51-f0886fe04c4d req-16069bf0-aa68-49df-820b-cd6b3e4dba70 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:22.032394 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-553f0fe4-3f9b-4fb3-8d51-f0886fe04c4d req-16069bf0-aa68-49df-820b-cd6b3e4dba70 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:22.045165 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-553f0fe4-3f9b-4fb3-8d51-f0886fe04c4d req-16069bf0-aa68-49df-820b-cd6b3e4dba70 service nova] Creating event network-changed:92634527-2839-4585-b57d-a54684637b9f for instance 5b0caba3-ed91-4ea7-a868-4f38cc779fc1 on hv-cinder-84617 Jun 16 19:50:22.051920 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-553f0fe4-3f9b-4fb3-8d51-f0886fe04c4d req-16069bf0-aa68-49df-820b-cd6b3e4dba70 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040345 Jun 16 19:50:22.053177 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 513/1000] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:50:22.140977 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-72eb8ddc-ca57-4c8f-8360-7a5fb4d8d562 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:22.142108 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-72eb8ddc-ca57-4c8f-8360-7a5fb4d8d562 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:22.151478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-72eb8ddc-ca57-4c8f-8360-7a5fb4d8d562 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:22.151940 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-72eb8ddc-ca57-4c8f-8360-7a5fb4d8d562 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:22.152951 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-72eb8ddc-ca57-4c8f-8360-7a5fb4d8d562 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:22.154376 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-72eb8ddc-ca57-4c8f-8360-7a5fb4d8d562 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:22.519150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-72eb8ddc-ca57-4c8f-8360-7a5fb4d8d562 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:22.527735 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-72eb8ddc-ca57-4c8f-8360-7a5fb4d8d562 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1259 microversion: 2.1 time: 0.391799 Jun 16 19:50:22.528679 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 488/1001] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:22 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1259 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:23.023146 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-87071d77-1ece-4c12-8408-716f62add917 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:23.024778 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-87071d77-1ece-4c12-8408-716f62add917 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:23.034541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-87071d77-1ece-4c12-8408-716f62add917 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:23.035179 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-87071d77-1ece-4c12-8408-716f62add917 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:23.036187 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-87071d77-1ece-4c12-8408-716f62add917 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:23.036701 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-87071d77-1ece-4c12-8408-716f62add917 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:23.172015 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-87071d77-1ece-4c12-8408-716f62add917 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:23.180280 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-87071d77-1ece-4c12-8408-716f62add917 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 200 len: 1367 microversion: 2.1 time: 0.161664 Jun 16 19:50:23.181345 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 514/1002] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:23 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:23.456596 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ef0b42b7-d45e-4133-8b02-ee97780fc650 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:23.457160 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ef0b42b7-d45e-4133-8b02-ee97780fc650 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:23.464217 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ef0b42b7-d45e-4133-8b02-ee97780fc650 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:23.464669 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ef0b42b7-d45e-4133-8b02-ee97780fc650 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:23.465633 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ef0b42b7-d45e-4133-8b02-ee97780fc650 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:23.466082 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ef0b42b7-d45e-4133-8b02-ee97780fc650 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:23.491424 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ef0b42b7-d45e-4133-8b02-ee97780fc650 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23/ips" status: 200 len: 152 microversion: 2.20 time: 0.040448 Jun 16 19:50:23.492050 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 489/1003] 10.222.0.36 () {60 vars in 1288 bytes} [Thu Jun 16 19:50:23 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:50:23.547634 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0b005b4d-195a-4468-8e3a-fad588cce753 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:23.548284 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0b005b4d-195a-4468-8e3a-fad588cce753 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:23.554351 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0b005b4d-195a-4468-8e3a-fad588cce753 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:23.554799 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0b005b4d-195a-4468-8e3a-fad588cce753 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:23.555599 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0b005b4d-195a-4468-8e3a-fad588cce753 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:23.556036 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0b005b4d-195a-4468-8e3a-fad588cce753 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:23.701113 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-52dfab52-9bf5-4ffe-9622-d84ce58522dd req-f337f5d4-acac-483e-b7aa-319a5e456227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a044da-c83d-4141-bb87-82809c1b7f42", "tag": "37674fcb-245a-4781-836c-6ae3cfe123bc"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:50:23.710637 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-52dfab52-9bf5-4ffe-9622-d84ce58522dd req-f337f5d4-acac-483e-b7aa-319a5e456227 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:23.711517 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-52dfab52-9bf5-4ffe-9622-d84ce58522dd req-f337f5d4-acac-483e-b7aa-319a5e456227 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:23.727486 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-52dfab52-9bf5-4ffe-9622-d84ce58522dd req-f337f5d4-acac-483e-b7aa-319a5e456227 service nova] Creating event network-changed:37674fcb-245a-4781-836c-6ae3cfe123bc for instance f9a044da-c83d-4141-bb87-82809c1b7f42 on hv-cinder-84617 Jun 16 19:50:23.732853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-52dfab52-9bf5-4ffe-9622-d84ce58522dd req-f337f5d4-acac-483e-b7aa-319a5e456227 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038046 Jun 16 19:50:23.733667 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 490/1004] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:50:23.762373 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0b005b4d-195a-4468-8e3a-fad588cce753 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:23.771112 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0b005b4d-195a-4468-8e3a-fad588cce753 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1259 microversion: 2.1 time: 0.227364 Jun 16 19:50:23.778815 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 515/1005] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:23 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:24.199416 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d4509684-f1f0-47ab-940a-22f2605cb45d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:24.200191 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d4509684-f1f0-47ab-940a-22f2605cb45d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:24.207633 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d4509684-f1f0-47ab-940a-22f2605cb45d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:24.208322 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d4509684-f1f0-47ab-940a-22f2605cb45d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:24.209085 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d4509684-f1f0-47ab-940a-22f2605cb45d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:24.209704 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d4509684-f1f0-47ab-940a-22f2605cb45d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:24.353828 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d4509684-f1f0-47ab-940a-22f2605cb45d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:24.361725 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d4509684-f1f0-47ab-940a-22f2605cb45d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 200 len: 1367 microversion: 2.1 time: 0.168111 Jun 16 19:50:24.362309 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 491/1006] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:24 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:50:24.788137 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-97f19611-bdc4-44ed-9444-8a1d43e9b96e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:24.788673 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-97f19611-bdc4-44ed-9444-8a1d43e9b96e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:24.795359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-97f19611-bdc4-44ed-9444-8a1d43e9b96e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:24.795808 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-97f19611-bdc4-44ed-9444-8a1d43e9b96e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:24.796568 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-97f19611-bdc4-44ed-9444-8a1d43e9b96e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:24.797006 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-97f19611-bdc4-44ed-9444-8a1d43e9b96e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:24.930887 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-97f19611-bdc4-44ed-9444-8a1d43e9b96e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:24.938313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-97f19611-bdc4-44ed-9444-8a1d43e9b96e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1259 microversion: 2.1 time: 0.154495 Jun 16 19:50:24.938912 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 516/1007] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:24 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:25.380043 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-358eee0d-25b4-417c-a6ee-36b36116f950 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:25.380706 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-358eee0d-25b4-417c-a6ee-36b36116f950 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:25.387145 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-358eee0d-25b4-417c-a6ee-36b36116f950 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:25.387588 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-358eee0d-25b4-417c-a6ee-36b36116f950 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:25.388329 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-358eee0d-25b4-417c-a6ee-36b36116f950 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:25.388754 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-358eee0d-25b4-417c-a6ee-36b36116f950 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:25.536188 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-358eee0d-25b4-417c-a6ee-36b36116f950 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:25.544170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-358eee0d-25b4-417c-a6ee-36b36116f950 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 200 len: 1367 microversion: 2.1 time: 0.168555 Jun 16 19:50:25.550702 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 492/1008] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:25 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:25.955235 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-906f71bd-0b6f-439f-9bc0-2ad931808cce tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:25.956580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-906f71bd-0b6f-439f-9bc0-2ad931808cce tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:25.959293 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b943a0fd-f5ed-4184-8545-853b984150e3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:50:25.959827 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b943a0fd-f5ed-4184-8545-853b984150e3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:25.963617 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-906f71bd-0b6f-439f-9bc0-2ad931808cce tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:25.964065 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-906f71bd-0b6f-439f-9bc0-2ad931808cce tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:25.965081 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-906f71bd-0b6f-439f-9bc0-2ad931808cce tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:25.965572 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-906f71bd-0b6f-439f-9bc0-2ad931808cce tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:25.965729 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b943a0fd-f5ed-4184-8545-853b984150e3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:25.966241 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b943a0fd-f5ed-4184-8545-853b984150e3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:25.967039 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b943a0fd-f5ed-4184-8545-853b984150e3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:25.967469 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b943a0fd-f5ed-4184-8545-853b984150e3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:26.003306 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-b943a0fd-f5ed-4184-8545-853b984150e3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lazy-loading 'flavor' on Instance uuid 763636a9-34c8-47b8-8f39-fdbc2ff40e23 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:50:26.098851 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-906f71bd-0b6f-439f-9bc0-2ad931808cce tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:26.106987 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-906f71bd-0b6f-439f-9bc0-2ad931808cce tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1259 microversion: 2.1 time: 0.156064 Jun 16 19:50:26.107552 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 517/1009] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:25 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:26.561630 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9d1b428f-0691-4a85-bba9-40a786aae84e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:26.562501 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9d1b428f-0691-4a85-bba9-40a786aae84e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:26.570111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9d1b428f-0691-4a85-bba9-40a786aae84e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:26.570810 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9d1b428f-0691-4a85-bba9-40a786aae84e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:26.571663 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9d1b428f-0691-4a85-bba9-40a786aae84e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:26.572102 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9d1b428f-0691-4a85-bba9-40a786aae84e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:26.718953 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9d1b428f-0691-4a85-bba9-40a786aae84e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:26.726289 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9d1b428f-0691-4a85-bba9-40a786aae84e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 200 len: 1367 microversion: 2.1 time: 0.168807 Jun 16 19:50:26.726853 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 518/1010] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:26 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:50:26.894156 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b943a0fd-f5ed-4184-8545-853b984150e3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "POST /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23/action" status: 202 len: 0 microversion: 2.20 time: 0.939371 Jun 16 19:50:26.895103 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 493/1011] 10.222.0.36 () {62 vars in 1318 bytes} [Thu Jun 16 19:50:25 2022] POST /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23/action => generated 0 bytes in 941 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:50:26.903213 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-4e981224-9cf0-43ea-ac7a-075397310a4f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:26.903825 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-4e981224-9cf0-43ea-ac7a-075397310a4f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:26.905751 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=4 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:50:26.906423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=12 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:50:26.911255 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4e981224-9cf0-43ea-ac7a-075397310a4f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:26.911709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4e981224-9cf0-43ea-ac7a-075397310a4f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:26.912481 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4e981224-9cf0-43ea-ac7a-075397310a4f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:26.912919 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4e981224-9cf0-43ea-ac7a-075397310a4f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:27.042834 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-4e981224-9cf0-43ea-ac7a-075397310a4f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:27.051106 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-4e981224-9cf0-43ea-ac7a-075397310a4f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:27.052865 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-4e981224-9cf0-43ea-ac7a-075397310a4f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:27.054146 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-4e981224-9cf0-43ea-ac7a-075397310a4f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1723 microversion: 2.20 time: 0.154791 Jun 16 19:50:27.054744 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 519/1012] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:26 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:27.125063 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-683cd731-b167-456d-85c0-7473c7101fa3 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:27.125759 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-683cd731-b167-456d-85c0-7473c7101fa3 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:27.132796 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-683cd731-b167-456d-85c0-7473c7101fa3 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:27.133237 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-683cd731-b167-456d-85c0-7473c7101fa3 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:27.133999 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-683cd731-b167-456d-85c0-7473c7101fa3 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:27.134489 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-683cd731-b167-456d-85c0-7473c7101fa3 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:27.285212 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-683cd731-b167-456d-85c0-7473c7101fa3 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:27.292707 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-683cd731-b167-456d-85c0-7473c7101fa3 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1259 microversion: 2.1 time: 0.171869 Jun 16 19:50:27.293268 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 494/1013] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:27 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:27.743580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0862efdc-974e-4293-ad9e-75aca112ff1d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:27.744226 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0862efdc-974e-4293-ad9e-75aca112ff1d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:27.750229 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0862efdc-974e-4293-ad9e-75aca112ff1d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:27.750677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0862efdc-974e-4293-ad9e-75aca112ff1d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:27.752010 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0862efdc-974e-4293-ad9e-75aca112ff1d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:27.752446 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0862efdc-974e-4293-ad9e-75aca112ff1d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:27.879177 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0862efdc-974e-4293-ad9e-75aca112ff1d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:27.886680 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0862efdc-974e-4293-ad9e-75aca112ff1d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 200 len: 1367 microversion: 2.1 time: 0.146925 Jun 16 19:50:27.887289 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 520/1014] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:27 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:28.072872 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-18f14df1-2e0c-417f-907a-364eeff07d6a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:28.073480 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-18f14df1-2e0c-417f-907a-364eeff07d6a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:28.079812 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-18f14df1-2e0c-417f-907a-364eeff07d6a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:28.080251 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-18f14df1-2e0c-417f-907a-364eeff07d6a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:28.084551 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-18f14df1-2e0c-417f-907a-364eeff07d6a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:28.084551 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-18f14df1-2e0c-417f-907a-364eeff07d6a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:28.207709 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-18f14df1-2e0c-417f-907a-364eeff07d6a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:28.215535 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-18f14df1-2e0c-417f-907a-364eeff07d6a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:28.217016 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-18f14df1-2e0c-417f-907a-364eeff07d6a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:28.218149 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-18f14df1-2e0c-417f-907a-364eeff07d6a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1723 microversion: 2.20 time: 0.149175 Jun 16 19:50:28.218696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 495/1015] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:28 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:28.309823 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-948c4d38-c09b-4f3e-bc3a-0e173fa05991 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:28.310435 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-948c4d38-c09b-4f3e-bc3a-0e173fa05991 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:28.317405 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-948c4d38-c09b-4f3e-bc3a-0e173fa05991 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:28.317883 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-948c4d38-c09b-4f3e-bc3a-0e173fa05991 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:28.318840 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-948c4d38-c09b-4f3e-bc3a-0e173fa05991 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:28.319388 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-948c4d38-c09b-4f3e-bc3a-0e173fa05991 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:28.448289 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-948c4d38-c09b-4f3e-bc3a-0e173fa05991 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:28.456377 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-948c4d38-c09b-4f3e-bc3a-0e173fa05991 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1259 microversion: 2.1 time: 0.150766 Jun 16 19:50:28.456875 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 521/1016] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:28 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:28.903103 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-722480a2-45ff-4e00-bc73-16e7690292de tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:28.903713 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-722480a2-45ff-4e00-bc73-16e7690292de tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:28.905620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=12 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:50:28.910315 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-722480a2-45ff-4e00-bc73-16e7690292de tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:28.910766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-722480a2-45ff-4e00-bc73-16e7690292de tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:28.911568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-722480a2-45ff-4e00-bc73-16e7690292de tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:28.912002 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-722480a2-45ff-4e00-bc73-16e7690292de tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:29.041630 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-722480a2-45ff-4e00-bc73-16e7690292de tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:29.049499 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-722480a2-45ff-4e00-bc73-16e7690292de tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 200 len: 1367 microversion: 2.1 time: 0.150152 Jun 16 19:50:29.050061 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 496/1017] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:28 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:29.237760 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-fe904704-4843-4a4b-bc59-5fe051f61c00 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:29.238288 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-fe904704-4843-4a4b-bc59-5fe051f61c00 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:29.245723 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fe904704-4843-4a4b-bc59-5fe051f61c00 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:29.246203 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fe904704-4843-4a4b-bc59-5fe051f61c00 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:29.246988 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fe904704-4843-4a4b-bc59-5fe051f61c00 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:29.247456 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-fe904704-4843-4a4b-bc59-5fe051f61c00 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:29.383646 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-fe904704-4843-4a4b-bc59-5fe051f61c00 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:29.391725 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-dc737caf-d696-4479-a3b3-ddebd3e31ace req-949b2206-732e-4a0e-b582-d4d460540c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a044da-c83d-4141-bb87-82809c1b7f42", "name": "network-vif-plugged", "status": "completed", "tag": "37674fcb-245a-4781-836c-6ae3cfe123bc"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:50:29.392335 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-fe904704-4843-4a4b-bc59-5fe051f61c00 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:29.393846 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-fe904704-4843-4a4b-bc59-5fe051f61c00 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:29.395078 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-fe904704-4843-4a4b-bc59-5fe051f61c00 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1723 microversion: 2.20 time: 0.162139 Jun 16 19:50:29.395643 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 522/1018] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:29 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:29.401084 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-dc737caf-d696-4479-a3b3-ddebd3e31ace req-949b2206-732e-4a0e-b582-d4d460540c59 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:29.401533 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-dc737caf-d696-4479-a3b3-ddebd3e31ace req-949b2206-732e-4a0e-b582-d4d460540c59 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:29.414228 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-dc737caf-d696-4479-a3b3-ddebd3e31ace req-949b2206-732e-4a0e-b582-d4d460540c59 service nova] Creating event network-vif-plugged:37674fcb-245a-4781-836c-6ae3cfe123bc for instance f9a044da-c83d-4141-bb87-82809c1b7f42 on hv-cinder-84617 Jun 16 19:50:29.431987 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-dc737caf-d696-4479-a3b3-ddebd3e31ace req-949b2206-732e-4a0e-b582-d4d460540c59 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039711 Jun 16 19:50:29.431987 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 497/1019] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:50:29.473782 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a61e4cee-9070-4a36-a515-e473f86bea1e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:29.474509 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a61e4cee-9070-4a36-a515-e473f86bea1e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:29.481097 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a61e4cee-9070-4a36-a515-e473f86bea1e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:29.489203 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a61e4cee-9070-4a36-a515-e473f86bea1e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:29.489203 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a61e4cee-9070-4a36-a515-e473f86bea1e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:29.489203 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a61e4cee-9070-4a36-a515-e473f86bea1e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:29.623474 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a61e4cee-9070-4a36-a515-e473f86bea1e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:29.630938 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a61e4cee-9070-4a36-a515-e473f86bea1e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1259 microversion: 2.1 time: 0.161613 Jun 16 19:50:29.631505 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 523/1020] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:29 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:30.067281 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-28e76105-e875-4c4e-a1c2-771790eabdcb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:30.067921 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-28e76105-e875-4c4e-a1c2-771790eabdcb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:30.074018 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-28e76105-e875-4c4e-a1c2-771790eabdcb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:30.074456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-28e76105-e875-4c4e-a1c2-771790eabdcb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:30.075228 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-28e76105-e875-4c4e-a1c2-771790eabdcb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:30.075655 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-28e76105-e875-4c4e-a1c2-771790eabdcb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:30.205477 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-28e76105-e875-4c4e-a1c2-771790eabdcb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:30.212800 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-28e76105-e875-4c4e-a1c2-771790eabdcb tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 200 len: 1367 microversion: 2.1 time: 0.150132 Jun 16 19:50:30.213351 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 498/1021] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:30 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:30.413132 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-78b4e7d2-ebff-440b-bdbf-2559644f22bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:30.413664 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-78b4e7d2-ebff-440b-bdbf-2559644f22bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:30.420434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-78b4e7d2-ebff-440b-bdbf-2559644f22bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:30.420883 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-78b4e7d2-ebff-440b-bdbf-2559644f22bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:30.421642 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-78b4e7d2-ebff-440b-bdbf-2559644f22bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:30.422082 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-78b4e7d2-ebff-440b-bdbf-2559644f22bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:30.546951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-78b4e7d2-ebff-440b-bdbf-2559644f22bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:30.554947 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-78b4e7d2-ebff-440b-bdbf-2559644f22bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:30.556446 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-78b4e7d2-ebff-440b-bdbf-2559644f22bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:30.557605 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-78b4e7d2-ebff-440b-bdbf-2559644f22bb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1723 microversion: 2.20 time: 0.148486 Jun 16 19:50:30.560147 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 524/1022] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:30 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:30.647024 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-53ca39c4-3b53-4c3e-8a18-6bf6aa0d94dc tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:30.647631 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-53ca39c4-3b53-4c3e-8a18-6bf6aa0d94dc tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:30.654956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-53ca39c4-3b53-4c3e-8a18-6bf6aa0d94dc tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:30.655415 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-53ca39c4-3b53-4c3e-8a18-6bf6aa0d94dc tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:30.656169 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-53ca39c4-3b53-4c3e-8a18-6bf6aa0d94dc tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:30.656596 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-53ca39c4-3b53-4c3e-8a18-6bf6aa0d94dc tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:30.786044 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-53ca39c4-3b53-4c3e-8a18-6bf6aa0d94dc tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:30.794195 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-53ca39c4-3b53-4c3e-8a18-6bf6aa0d94dc tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1259 microversion: 2.1 time: 0.150990 Jun 16 19:50:30.794750 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 499/1023] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:30 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:31.229625 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b3cb2bbd-b543-4824-885e-a005863561c3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:31.230254 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b3cb2bbd-b543-4824-885e-a005863561c3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:31.236267 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b3cb2bbd-b543-4824-885e-a005863561c3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:31.236669 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b3cb2bbd-b543-4824-885e-a005863561c3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:31.237434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b3cb2bbd-b543-4824-885e-a005863561c3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:31.237876 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b3cb2bbd-b543-4824-885e-a005863561c3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:31.370680 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b3cb2bbd-b543-4824-885e-a005863561c3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:31.378183 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b3cb2bbd-b543-4824-885e-a005863561c3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 200 len: 1367 microversion: 2.1 time: 0.152470 Jun 16 19:50:31.378741 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 525/1024] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:31 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:31.576793 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1d786a79-9983-48a6-905b-4dcf57f454b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:31.577317 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1d786a79-9983-48a6-905b-4dcf57f454b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:31.583583 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1d786a79-9983-48a6-905b-4dcf57f454b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:31.584028 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1d786a79-9983-48a6-905b-4dcf57f454b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:31.584779 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1d786a79-9983-48a6-905b-4dcf57f454b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:31.585210 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1d786a79-9983-48a6-905b-4dcf57f454b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:31.718510 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1d786a79-9983-48a6-905b-4dcf57f454b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:31.726877 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1d786a79-9983-48a6-905b-4dcf57f454b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:31.728596 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1d786a79-9983-48a6-905b-4dcf57f454b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:31.729745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1d786a79-9983-48a6-905b-4dcf57f454b9 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1723 microversion: 2.20 time: 0.157543 Jun 16 19:50:31.730298 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 500/1025] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:31 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:31.812019 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5295abe5-a2c2-47d2-9286-7028fc9e4aa9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:31.812797 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5295abe5-a2c2-47d2-9286-7028fc9e4aa9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:31.819676 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5295abe5-a2c2-47d2-9286-7028fc9e4aa9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:31.820133 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5295abe5-a2c2-47d2-9286-7028fc9e4aa9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:31.820906 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5295abe5-a2c2-47d2-9286-7028fc9e4aa9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:31.821347 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5295abe5-a2c2-47d2-9286-7028fc9e4aa9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:31.951631 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5295abe5-a2c2-47d2-9286-7028fc9e4aa9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:31.959725 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5295abe5-a2c2-47d2-9286-7028fc9e4aa9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1259 microversion: 2.1 time: 0.151573 Jun 16 19:50:31.960285 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 526/1026] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:31 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:32.394858 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4e6c61da-5198-4226-b494-fe74aa30c925 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:32.395581 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4e6c61da-5198-4226-b494-fe74aa30c925 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:32.401693 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4e6c61da-5198-4226-b494-fe74aa30c925 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:32.402249 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4e6c61da-5198-4226-b494-fe74aa30c925 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:32.403058 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4e6c61da-5198-4226-b494-fe74aa30c925 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:32.403494 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4e6c61da-5198-4226-b494-fe74aa30c925 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:32.421905 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:50:32.531154 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4e6c61da-5198-4226-b494-fe74aa30c925 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:32.539001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4e6c61da-5198-4226-b494-fe74aa30c925 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 200 len: 1558 microversion: 2.1 time: 0.148002 Jun 16 19:50:32.539567 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 501/1027] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:32 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:32.563318 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7f157760-e98a-4db7-8273-c21f81ed5eab tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:32.566703 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-7f157760-e98a-4db7-8273-c21f81ed5eab tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:32.569940 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7f157760-e98a-4db7-8273-c21f81ed5eab tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:32.570501 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7f157760-e98a-4db7-8273-c21f81ed5eab tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:32.571300 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7f157760-e98a-4db7-8273-c21f81ed5eab tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:32.571731 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7f157760-e98a-4db7-8273-c21f81ed5eab tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:32.650774 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-7f157760-e98a-4db7-8273-c21f81ed5eab tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098771 Jun 16 19:50:32.651432 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 527/1028] 10.222.0.36 () {58 vars in 1274 bytes} [Thu Jun 16 19:50:32 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:50:32.748193 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c53f7fc8-69fa-4913-9f26-72809d9a0f69 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:32.748803 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c53f7fc8-69fa-4913-9f26-72809d9a0f69 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:32.757507 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c53f7fc8-69fa-4913-9f26-72809d9a0f69 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:32.757507 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c53f7fc8-69fa-4913-9f26-72809d9a0f69 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:32.757507 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c53f7fc8-69fa-4913-9f26-72809d9a0f69 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:32.757507 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c53f7fc8-69fa-4913-9f26-72809d9a0f69 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:32.890869 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c53f7fc8-69fa-4913-9f26-72809d9a0f69 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:32.899571 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c53f7fc8-69fa-4913-9f26-72809d9a0f69 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:32.901514 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c53f7fc8-69fa-4913-9f26-72809d9a0f69 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:32.902667 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c53f7fc8-69fa-4913-9f26-72809d9a0f69 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1723 microversion: 2.20 time: 0.158608 Jun 16 19:50:32.903261 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 502/1029] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:32 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:32.977564 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3c8d0566-afe5-4bd0-80ae-ac91f3091d14 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:32.978187 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-3c8d0566-afe5-4bd0-80ae-ac91f3091d14 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:32.984583 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3c8d0566-afe5-4bd0-80ae-ac91f3091d14 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:32.985064 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3c8d0566-afe5-4bd0-80ae-ac91f3091d14 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:32.991756 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3c8d0566-afe5-4bd0-80ae-ac91f3091d14 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:32.991756 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3c8d0566-afe5-4bd0-80ae-ac91f3091d14 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:33.195872 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3c8d0566-afe5-4bd0-80ae-ac91f3091d14 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:33.203431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-3c8d0566-afe5-4bd0-80ae-ac91f3091d14 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1259 microversion: 2.1 time: 0.230226 Jun 16 19:50:33.204016 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 528/1030] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:32 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1259 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:33.369546 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-587ebf32-429d-45b9-adcc-1a87f86f6962 req-ba1e2194-3244-4bf4-bbed-e7720087b97c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0caba3-ed91-4ea7-a868-4f38cc779fc1", "name": "network-vif-plugged", "status": "completed", "tag": "92634527-2839-4585-b57d-a54684637b9f"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:50:33.387728 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-587ebf32-429d-45b9-adcc-1a87f86f6962 req-ba1e2194-3244-4bf4-bbed-e7720087b97c service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:33.387728 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-587ebf32-429d-45b9-adcc-1a87f86f6962 req-ba1e2194-3244-4bf4-bbed-e7720087b97c service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:33.389954 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-587ebf32-429d-45b9-adcc-1a87f86f6962 req-ba1e2194-3244-4bf4-bbed-e7720087b97c service nova] Creating event network-vif-plugged:92634527-2839-4585-b57d-a54684637b9f for instance 5b0caba3-ed91-4ea7-a868-4f38cc779fc1 on hv-cinder-84617 Jun 16 19:50:33.394810 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-587ebf32-429d-45b9-adcc-1a87f86f6962 req-ba1e2194-3244-4bf4-bbed-e7720087b97c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029233 Jun 16 19:50:33.395443 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 503/1031] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:50:33.921987 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-963661e7-33db-4a45-9040-e4a08df56d59 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:33.922700 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-963661e7-33db-4a45-9040-e4a08df56d59 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:34.012280 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-963661e7-33db-4a45-9040-e4a08df56d59 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:34.012953 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-963661e7-33db-4a45-9040-e4a08df56d59 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:34.013514 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-963661e7-33db-4a45-9040-e4a08df56d59 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:34.014062 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-963661e7-33db-4a45-9040-e4a08df56d59 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:34.039099 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:50:34.058785 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-5c1f6b65-e364-4807-ad1c-05a88da8f297 req-64ff6393-1a1d-4d5c-9d17-4034f517e50e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a044da-c83d-4141-bb87-82809c1b7f42", "tag": "37674fcb-245a-4781-836c-6ae3cfe123bc"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:50:34.073128 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-5c1f6b65-e364-4807-ad1c-05a88da8f297 req-64ff6393-1a1d-4d5c-9d17-4034f517e50e service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:34.073575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-5c1f6b65-e364-4807-ad1c-05a88da8f297 req-64ff6393-1a1d-4d5c-9d17-4034f517e50e service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:34.086142 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-5c1f6b65-e364-4807-ad1c-05a88da8f297 req-64ff6393-1a1d-4d5c-9d17-4034f517e50e service nova] Creating event network-changed:37674fcb-245a-4781-836c-6ae3cfe123bc for instance f9a044da-c83d-4141-bb87-82809c1b7f42 on hv-cinder-84617 Jun 16 19:50:34.092039 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-5c1f6b65-e364-4807-ad1c-05a88da8f297 req-64ff6393-1a1d-4d5c-9d17-4034f517e50e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039770 Jun 16 19:50:34.093156 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 504/1032] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:50:34.183421 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-963661e7-33db-4a45-9040-e4a08df56d59 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:34.192579 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-963661e7-33db-4a45-9040-e4a08df56d59 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:34.194137 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-963661e7-33db-4a45-9040-e4a08df56d59 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:34.195411 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-963661e7-33db-4a45-9040-e4a08df56d59 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1723 microversion: 2.20 time: 0.277649 Jun 16 19:50:34.196060 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 529/1033] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:33 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:34.222423 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7967dc15-ebe3-48a3-9928-d402099175d0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:34.223270 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7967dc15-ebe3-48a3-9928-d402099175d0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:34.229965 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7967dc15-ebe3-48a3-9928-d402099175d0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:34.230187 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7967dc15-ebe3-48a3-9928-d402099175d0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:34.231295 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7967dc15-ebe3-48a3-9928-d402099175d0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:34.231730 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7967dc15-ebe3-48a3-9928-d402099175d0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:34.389081 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7967dc15-ebe3-48a3-9928-d402099175d0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:34.397882 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7967dc15-ebe3-48a3-9928-d402099175d0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1259 microversion: 2.1 time: 0.180147 Jun 16 19:50:34.398498 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 505/1034] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:34 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:35.214944 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a81315c1-19cb-4ff2-95a0-9c1f86596f55 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:35.215658 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a81315c1-19cb-4ff2-95a0-9c1f86596f55 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:35.222681 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a81315c1-19cb-4ff2-95a0-9c1f86596f55 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:35.223173 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a81315c1-19cb-4ff2-95a0-9c1f86596f55 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:35.223965 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a81315c1-19cb-4ff2-95a0-9c1f86596f55 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:35.224411 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a81315c1-19cb-4ff2-95a0-9c1f86596f55 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:35.371301 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a81315c1-19cb-4ff2-95a0-9c1f86596f55 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:35.379929 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a81315c1-19cb-4ff2-95a0-9c1f86596f55 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:35.381416 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a81315c1-19cb-4ff2-95a0-9c1f86596f55 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:35.382568 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a81315c1-19cb-4ff2-95a0-9c1f86596f55 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1723 microversion: 2.20 time: 0.172202 Jun 16 19:50:35.383148 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 530/1035] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:35 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:35.421200 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9c1e5077-9a98-4860-9840-a4a41f67868d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:35.421200 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9c1e5077-9a98-4860-9840-a4a41f67868d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:35.429291 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9c1e5077-9a98-4860-9840-a4a41f67868d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:35.434052 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9c1e5077-9a98-4860-9840-a4a41f67868d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:35.434842 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9c1e5077-9a98-4860-9840-a4a41f67868d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:35.435305 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9c1e5077-9a98-4860-9840-a4a41f67868d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:35.576588 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9c1e5077-9a98-4860-9840-a4a41f67868d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:35.584316 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9c1e5077-9a98-4860-9840-a4a41f67868d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1259 microversion: 2.1 time: 0.174527 Jun 16 19:50:35.584887 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 506/1036] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:35 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:36.401705 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1b274b22-f3f4-4025-8ba7-8ce96f307034 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:36.402332 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-1b274b22-f3f4-4025-8ba7-8ce96f307034 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:36.408893 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1b274b22-f3f4-4025-8ba7-8ce96f307034 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:36.409346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1b274b22-f3f4-4025-8ba7-8ce96f307034 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:36.410124 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1b274b22-f3f4-4025-8ba7-8ce96f307034 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:36.410566 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1b274b22-f3f4-4025-8ba7-8ce96f307034 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:36.540247 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1b274b22-f3f4-4025-8ba7-8ce96f307034 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:36.548124 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1b274b22-f3f4-4025-8ba7-8ce96f307034 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:36.549626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1b274b22-f3f4-4025-8ba7-8ce96f307034 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:36.550781 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-1b274b22-f3f4-4025-8ba7-8ce96f307034 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1723 microversion: 2.20 time: 0.153195 Jun 16 19:50:36.551389 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 531/1037] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:36 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:36.604031 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ed091554-8fe3-4f38-8821-c37b72ddfe84 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:36.604737 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ed091554-8fe3-4f38-8821-c37b72ddfe84 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:36.621830 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed091554-8fe3-4f38-8821-c37b72ddfe84 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:36.621830 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed091554-8fe3-4f38-8821-c37b72ddfe84 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:36.621830 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed091554-8fe3-4f38-8821-c37b72ddfe84 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:36.621830 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed091554-8fe3-4f38-8821-c37b72ddfe84 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:36.753045 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ed091554-8fe3-4f38-8821-c37b72ddfe84 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:36.760474 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ed091554-8fe3-4f38-8821-c37b72ddfe84 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1443 microversion: 2.1 time: 0.160704 Jun 16 19:50:36.761043 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 507/1038] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:36 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:36.783786 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c1679317-11ee-4ad2-ba7e-6ddbfaa1abe0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:36.784655 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c1679317-11ee-4ad2-ba7e-6ddbfaa1abe0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:36.791011 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c1679317-11ee-4ad2-ba7e-6ddbfaa1abe0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:36.791421 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c1679317-11ee-4ad2-ba7e-6ddbfaa1abe0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:36.792263 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c1679317-11ee-4ad2-ba7e-6ddbfaa1abe0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:36.792796 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c1679317-11ee-4ad2-ba7e-6ddbfaa1abe0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:36.925369 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c1679317-11ee-4ad2-ba7e-6ddbfaa1abe0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:36.932871 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c1679317-11ee-4ad2-ba7e-6ddbfaa1abe0 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1443 microversion: 2.1 time: 0.153848 Jun 16 19:50:36.933432 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 532/1039] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:50:36 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:50:37.570114 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-591470bd-83ea-4a17-b041-5d1a06bbde27 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:37.570976 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-591470bd-83ea-4a17-b041-5d1a06bbde27 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:37.577238 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-591470bd-83ea-4a17-b041-5d1a06bbde27 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:37.577972 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-591470bd-83ea-4a17-b041-5d1a06bbde27 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:37.578876 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-591470bd-83ea-4a17-b041-5d1a06bbde27 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:37.579452 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-591470bd-83ea-4a17-b041-5d1a06bbde27 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:37.734738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-591470bd-83ea-4a17-b041-5d1a06bbde27 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:37.745959 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-591470bd-83ea-4a17-b041-5d1a06bbde27 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:37.745959 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-591470bd-83ea-4a17-b041-5d1a06bbde27 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:37.745959 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-591470bd-83ea-4a17-b041-5d1a06bbde27 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1723 microversion: 2.20 time: 0.180346 Jun 16 19:50:37.746650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 508/1040] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:37 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:38.763732 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-12380214-1ebf-4cfe-b90b-2e80c8cc3f75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:38.764367 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-12380214-1ebf-4cfe-b90b-2e80c8cc3f75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:38.771369 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-12380214-1ebf-4cfe-b90b-2e80c8cc3f75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:38.771853 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-12380214-1ebf-4cfe-b90b-2e80c8cc3f75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:38.772566 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-12380214-1ebf-4cfe-b90b-2e80c8cc3f75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:38.772994 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-12380214-1ebf-4cfe-b90b-2e80c8cc3f75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:38.913564 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-12380214-1ebf-4cfe-b90b-2e80c8cc3f75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:38.921705 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-12380214-1ebf-4cfe-b90b-2e80c8cc3f75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:38.923225 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-12380214-1ebf-4cfe-b90b-2e80c8cc3f75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:38.924417 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-12380214-1ebf-4cfe-b90b-2e80c8cc3f75 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1723 microversion: 2.20 time: 0.164626 Jun 16 19:50:38.926495 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 533/1041] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:38 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:39.469447 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-071928e5-d852-4ca3-9a12-24c90c71a00a req-a47766b6-ba70-4033-b3ee-1585b5cdc0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b0caba3-ed91-4ea7-a868-4f38cc779fc1", "tag": "92634527-2839-4585-b57d-a54684637b9f"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:50:39.478019 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-071928e5-d852-4ca3-9a12-24c90c71a00a req-a47766b6-ba70-4033-b3ee-1585b5cdc0d4 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:39.478576 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-071928e5-d852-4ca3-9a12-24c90c71a00a req-a47766b6-ba70-4033-b3ee-1585b5cdc0d4 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:39.490443 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-071928e5-d852-4ca3-9a12-24c90c71a00a req-a47766b6-ba70-4033-b3ee-1585b5cdc0d4 service nova] Creating event network-changed:92634527-2839-4585-b57d-a54684637b9f for instance 5b0caba3-ed91-4ea7-a868-4f38cc779fc1 on hv-cinder-84617 Jun 16 19:50:39.495361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-071928e5-d852-4ca3-9a12-24c90c71a00a req-a47766b6-ba70-4033-b3ee-1585b5cdc0d4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029491 Jun 16 19:50:39.496198 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 509/1042] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:50:39.944642 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-551b644f-a990-4831-a892-58f4e0bc888f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:39.945824 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-551b644f-a990-4831-a892-58f4e0bc888f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:39.951877 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-551b644f-a990-4831-a892-58f4e0bc888f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:39.952333 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-551b644f-a990-4831-a892-58f4e0bc888f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:39.953268 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-551b644f-a990-4831-a892-58f4e0bc888f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:39.954467 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-551b644f-a990-4831-a892-58f4e0bc888f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:40.106680 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-551b644f-a990-4831-a892-58f4e0bc888f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:40.115530 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-551b644f-a990-4831-a892-58f4e0bc888f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:40.117052 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-551b644f-a990-4831-a892-58f4e0bc888f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:40.118213 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-551b644f-a990-4831-a892-58f4e0bc888f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1723 microversion: 2.20 time: 0.178916 Jun 16 19:50:40.118764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 534/1043] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:39 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:41.137309 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4738af25-ada5-4908-8a2a-a7c719a0dd98 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:41.138031 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4738af25-ada5-4908-8a2a-a7c719a0dd98 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:41.144311 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4738af25-ada5-4908-8a2a-a7c719a0dd98 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:41.144762 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4738af25-ada5-4908-8a2a-a7c719a0dd98 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:41.145519 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4738af25-ada5-4908-8a2a-a7c719a0dd98 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:41.145953 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4738af25-ada5-4908-8a2a-a7c719a0dd98 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:41.286955 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4738af25-ada5-4908-8a2a-a7c719a0dd98 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:41.294775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4738af25-ada5-4908-8a2a-a7c719a0dd98 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:41.300039 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4738af25-ada5-4908-8a2a-a7c719a0dd98 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:41.300039 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4738af25-ada5-4908-8a2a-a7c719a0dd98 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1723 microversion: 2.20 time: 0.165064 Jun 16 19:50:41.300039 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 510/1044] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:41 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:42.317032 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8a70dbce-e617-4674-9575-744e384cd09a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:42.322876 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8a70dbce-e617-4674-9575-744e384cd09a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:42.324307 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8a70dbce-e617-4674-9575-744e384cd09a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:42.324757 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8a70dbce-e617-4674-9575-744e384cd09a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:42.325526 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8a70dbce-e617-4674-9575-744e384cd09a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:42.325962 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8a70dbce-e617-4674-9575-744e384cd09a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:42.465389 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8a70dbce-e617-4674-9575-744e384cd09a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:42.475355 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8a70dbce-e617-4674-9575-744e384cd09a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:42.477666 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8a70dbce-e617-4674-9575-744e384cd09a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:42.478839 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8a70dbce-e617-4674-9575-744e384cd09a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1723 microversion: 2.20 time: 0.166455 Jun 16 19:50:42.479613 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 535/1045] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:42 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:43.497040 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-626faf81-1e9c-4d22-ab29-94aa6c5a6afd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:43.497637 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-626faf81-1e9c-4d22-ab29-94aa6c5a6afd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:43.506398 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-626faf81-1e9c-4d22-ab29-94aa6c5a6afd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:43.506844 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-626faf81-1e9c-4d22-ab29-94aa6c5a6afd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:43.507718 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-626faf81-1e9c-4d22-ab29-94aa6c5a6afd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:43.508149 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-626faf81-1e9c-4d22-ab29-94aa6c5a6afd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:43.636527 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-626faf81-1e9c-4d22-ab29-94aa6c5a6afd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:43.644986 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-626faf81-1e9c-4d22-ab29-94aa6c5a6afd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:43.646469 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-626faf81-1e9c-4d22-ab29-94aa6c5a6afd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:43.647628 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-626faf81-1e9c-4d22-ab29-94aa6c5a6afd tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1744 microversion: 2.20 time: 0.154486 Jun 16 19:50:43.648200 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 511/1046] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:43 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:44.665615 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-95f6c50c-e2ec-4d82-8dbd-671e665b312d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:44.666339 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-95f6c50c-e2ec-4d82-8dbd-671e665b312d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:44.673330 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-95f6c50c-e2ec-4d82-8dbd-671e665b312d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:44.675857 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-95f6c50c-e2ec-4d82-8dbd-671e665b312d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:44.675857 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-95f6c50c-e2ec-4d82-8dbd-671e665b312d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:44.675857 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-95f6c50c-e2ec-4d82-8dbd-671e665b312d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:44.805122 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-95f6c50c-e2ec-4d82-8dbd-671e665b312d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:44.813642 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-95f6c50c-e2ec-4d82-8dbd-671e665b312d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:44.815294 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-95f6c50c-e2ec-4d82-8dbd-671e665b312d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:44.816804 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-95f6c50c-e2ec-4d82-8dbd-671e665b312d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1744 microversion: 2.20 time: 0.155173 Jun 16 19:50:44.817432 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 536/1047] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:44 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:50:45.836261 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3de55130-fc8f-4ade-a13f-2eabc7ee62f2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:45.836872 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3de55130-fc8f-4ade-a13f-2eabc7ee62f2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:45.843308 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3de55130-fc8f-4ade-a13f-2eabc7ee62f2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:45.843760 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3de55130-fc8f-4ade-a13f-2eabc7ee62f2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:45.844524 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3de55130-fc8f-4ade-a13f-2eabc7ee62f2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:45.845460 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3de55130-fc8f-4ade-a13f-2eabc7ee62f2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:46.008152 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3de55130-fc8f-4ade-a13f-2eabc7ee62f2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:46.016523 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3de55130-fc8f-4ade-a13f-2eabc7ee62f2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:46.018402 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3de55130-fc8f-4ade-a13f-2eabc7ee62f2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:46.019547 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3de55130-fc8f-4ade-a13f-2eabc7ee62f2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1739 microversion: 2.20 time: 0.187183 Jun 16 19:50:46.020100 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 512/1048] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:45 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:47.038862 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-300ea9f0-899e-4edd-8397-505faf6821e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:47.039663 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-300ea9f0-899e-4edd-8397-505faf6821e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:47.045983 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-300ea9f0-899e-4edd-8397-505faf6821e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:47.046783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-300ea9f0-899e-4edd-8397-505faf6821e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:47.048552 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-300ea9f0-899e-4edd-8397-505faf6821e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:47.049229 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-300ea9f0-899e-4edd-8397-505faf6821e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:47.242062 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-300ea9f0-899e-4edd-8397-505faf6821e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:47.276658 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-300ea9f0-899e-4edd-8397-505faf6821e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:47.276658 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-300ea9f0-899e-4edd-8397-505faf6821e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:47.276658 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-300ea9f0-899e-4edd-8397-505faf6821e6 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1739 microversion: 2.20 time: 0.224805 Jun 16 19:50:47.277189 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 537/1049] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:47 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:47.333641 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-58213ff0-d0f9-4fa8-a557-3c0e16ec16eb req-bcacc486-54fc-404e-877e-22c87ec050ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "763636a9-34c8-47b8-8f39-fdbc2ff40e23", "name": "network-vif-plugged", "status": "completed", "tag": "6a3e5e5b-38d9-46c6-86d4-f4326eeff1a1"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:50:47.342800 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-58213ff0-d0f9-4fa8-a557-3c0e16ec16eb req-bcacc486-54fc-404e-877e-22c87ec050ee service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:47.343658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-58213ff0-d0f9-4fa8-a557-3c0e16ec16eb req-bcacc486-54fc-404e-877e-22c87ec050ee service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:47.359961 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-58213ff0-d0f9-4fa8-a557-3c0e16ec16eb req-bcacc486-54fc-404e-877e-22c87ec050ee service nova] Creating event network-vif-plugged:6a3e5e5b-38d9-46c6-86d4-f4326eeff1a1 for instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 on hv-cinder-84617 Jun 16 19:50:47.365307 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-58213ff0-d0f9-4fa8-a557-3c0e16ec16eb req-bcacc486-54fc-404e-877e-22c87ec050ee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036220 Jun 16 19:50:47.365885 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 513/1050] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:50:48.277071 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5a7ffae7-9194-479f-8173-c667432d2249 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:48.277916 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5a7ffae7-9194-479f-8173-c667432d2249 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:48.286600 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5a7ffae7-9194-479f-8173-c667432d2249 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:48.287338 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5a7ffae7-9194-479f-8173-c667432d2249 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:48.288152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5a7ffae7-9194-479f-8173-c667432d2249 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:48.288601 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5a7ffae7-9194-479f-8173-c667432d2249 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:48.457458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5a7ffae7-9194-479f-8173-c667432d2249 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:48.466152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5a7ffae7-9194-479f-8173-c667432d2249 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:48.468656 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5a7ffae7-9194-479f-8173-c667432d2249 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:48.468925 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5a7ffae7-9194-479f-8173-c667432d2249 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1739 microversion: 2.20 time: 0.195801 Jun 16 19:50:48.480193 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 538/1051] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:48 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:49.492739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-18f4b49a-9349-49ff-96d1-d2faef0e8af4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:49.493915 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-18f4b49a-9349-49ff-96d1-d2faef0e8af4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:49.514681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-18f4b49a-9349-49ff-96d1-d2faef0e8af4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:49.515336 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-18f4b49a-9349-49ff-96d1-d2faef0e8af4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:49.516269 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-18f4b49a-9349-49ff-96d1-d2faef0e8af4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:49.517374 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-18f4b49a-9349-49ff-96d1-d2faef0e8af4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:49.684227 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-18f4b49a-9349-49ff-96d1-d2faef0e8af4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:49.701062 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-18f4b49a-9349-49ff-96d1-d2faef0e8af4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:49.702901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-18f4b49a-9349-49ff-96d1-d2faef0e8af4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:49.707385 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-18f4b49a-9349-49ff-96d1-d2faef0e8af4 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1739 microversion: 2.20 time: 0.223329 Jun 16 19:50:49.720928 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 514/1052] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:49 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:50.728556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-740b9d39-0a2b-4ace-be1b-0abdfd717ebf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:50.730187 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-740b9d39-0a2b-4ace-be1b-0abdfd717ebf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:50.737657 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-740b9d39-0a2b-4ace-be1b-0abdfd717ebf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:50.738110 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-740b9d39-0a2b-4ace-be1b-0abdfd717ebf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:50.738888 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-740b9d39-0a2b-4ace-be1b-0abdfd717ebf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:50.739366 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-740b9d39-0a2b-4ace-be1b-0abdfd717ebf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:50.907698 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-740b9d39-0a2b-4ace-be1b-0abdfd717ebf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:50.917598 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-740b9d39-0a2b-4ace-be1b-0abdfd717ebf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:50.920493 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-740b9d39-0a2b-4ace-be1b-0abdfd717ebf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:50.921671 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-740b9d39-0a2b-4ace-be1b-0abdfd717ebf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1739 microversion: 2.20 time: 0.197155 Jun 16 19:50:50.922231 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 539/1053] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:50 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:51.943338 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-dc785759-a00c-4f04-b890-387b08e33571 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:51.946099 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-dc785759-a00c-4f04-b890-387b08e33571 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:51.953027 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc785759-a00c-4f04-b890-387b08e33571 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:51.953476 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc785759-a00c-4f04-b890-387b08e33571 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:51.954301 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc785759-a00c-4f04-b890-387b08e33571 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:51.954741 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc785759-a00c-4f04-b890-387b08e33571 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:52.089531 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-dc785759-a00c-4f04-b890-387b08e33571 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:52.098022 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-dc785759-a00c-4f04-b890-387b08e33571 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:52.099555 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-dc785759-a00c-4f04-b890-387b08e33571 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:52.100707 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-dc785759-a00c-4f04-b890-387b08e33571 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1739 microversion: 2.20 time: 0.161833 Jun 16 19:50:52.101269 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 515/1054] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:51 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:53.120878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-ba3d8992-2ffa-4fdf-8288-de3cdf6c6d4c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:53.122220 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-ba3d8992-2ffa-4fdf-8288-de3cdf6c6d4c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:53.144474 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ba3d8992-2ffa-4fdf-8288-de3cdf6c6d4c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:53.144946 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ba3d8992-2ffa-4fdf-8288-de3cdf6c6d4c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:53.146831 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ba3d8992-2ffa-4fdf-8288-de3cdf6c6d4c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:53.147309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ba3d8992-2ffa-4fdf-8288-de3cdf6c6d4c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:53.323193 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ba3d8992-2ffa-4fdf-8288-de3cdf6c6d4c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:53.332703 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ba3d8992-2ffa-4fdf-8288-de3cdf6c6d4c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:53.342813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ba3d8992-2ffa-4fdf-8288-de3cdf6c6d4c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:53.342813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-ba3d8992-2ffa-4fdf-8288-de3cdf6c6d4c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1739 microversion: 2.20 time: 0.220984 Jun 16 19:50:53.342813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 540/1055] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:53 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:54.362554 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c37c5ed6-bddd-481e-a8c3-7a840530c2ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:54.363460 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c37c5ed6-bddd-481e-a8c3-7a840530c2ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:54.369710 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c37c5ed6-bddd-481e-a8c3-7a840530c2ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:54.370295 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c37c5ed6-bddd-481e-a8c3-7a840530c2ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:54.371356 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c37c5ed6-bddd-481e-a8c3-7a840530c2ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:54.372043 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c37c5ed6-bddd-481e-a8c3-7a840530c2ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:54.567176 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c37c5ed6-bddd-481e-a8c3-7a840530c2ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:54.578622 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c37c5ed6-bddd-481e-a8c3-7a840530c2ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:54.580467 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c37c5ed6-bddd-481e-a8c3-7a840530c2ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:54.581670 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c37c5ed6-bddd-481e-a8c3-7a840530c2ce tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1739 microversion: 2.20 time: 0.225785 Jun 16 19:50:54.582225 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 516/1056] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:54 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:55.615809 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-08522fa8-0c96-4d40-b40f-a7b8a160deb8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:55.615809 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-08522fa8-0c96-4d40-b40f-a7b8a160deb8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:55.615809 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-08522fa8-0c96-4d40-b40f-a7b8a160deb8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:55.615809 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-08522fa8-0c96-4d40-b40f-a7b8a160deb8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:55.616592 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-08522fa8-0c96-4d40-b40f-a7b8a160deb8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:55.616592 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-08522fa8-0c96-4d40-b40f-a7b8a160deb8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:55.749397 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-08522fa8-0c96-4d40-b40f-a7b8a160deb8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:55.757877 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-08522fa8-0c96-4d40-b40f-a7b8a160deb8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:55.759406 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-08522fa8-0c96-4d40-b40f-a7b8a160deb8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:55.760554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-08522fa8-0c96-4d40-b40f-a7b8a160deb8 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1739 microversion: 2.20 time: 0.162064 Jun 16 19:50:55.761116 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 541/1057] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:55 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:56.779230 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-89382bad-bfb2-4bc8-8395-3e095aebfd92 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:56.779795 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-89382bad-bfb2-4bc8-8395-3e095aebfd92 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:56.782753 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=62 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:50:56.787521 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-89382bad-bfb2-4bc8-8395-3e095aebfd92 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:56.787970 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-89382bad-bfb2-4bc8-8395-3e095aebfd92 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:56.788735 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-89382bad-bfb2-4bc8-8395-3e095aebfd92 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:56.789173 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-89382bad-bfb2-4bc8-8395-3e095aebfd92 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:56.920235 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-89382bad-bfb2-4bc8-8395-3e095aebfd92 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:56.928064 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-89382bad-bfb2-4bc8-8395-3e095aebfd92 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:56.956855 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-89382bad-bfb2-4bc8-8395-3e095aebfd92 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:56.956855 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-89382bad-bfb2-4bc8-8395-3e095aebfd92 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1739 microversion: 2.20 time: 0.155660 Jun 16 19:50:56.956855 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 517/1058] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:56 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:57.949106 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d22de055-5891-4e26-991a-7184bd6c1c29 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:57.949699 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d22de055-5891-4e26-991a-7184bd6c1c29 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:57.956305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d22de055-5891-4e26-991a-7184bd6c1c29 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:57.956753 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d22de055-5891-4e26-991a-7184bd6c1c29 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:57.959642 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d22de055-5891-4e26-991a-7184bd6c1c29 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:57.959642 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d22de055-5891-4e26-991a-7184bd6c1c29 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:58.147061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d22de055-5891-4e26-991a-7184bd6c1c29 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:58.155125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d22de055-5891-4e26-991a-7184bd6c1c29 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:58.157193 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d22de055-5891-4e26-991a-7184bd6c1c29 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:58.158346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d22de055-5891-4e26-991a-7184bd6c1c29 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1721 microversion: 2.20 time: 0.213191 Jun 16 19:50:58.158905 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 542/1059] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:57 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:50:59.177574 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e7a7a680-bca7-4bc2-bd35-5066dd267373 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:50:59.178216 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e7a7a680-bca7-4bc2-bd35-5066dd267373 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:50:59.184878 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e7a7a680-bca7-4bc2-bd35-5066dd267373 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:59.185325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e7a7a680-bca7-4bc2-bd35-5066dd267373 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:59.186080 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e7a7a680-bca7-4bc2-bd35-5066dd267373 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:50:59.186508 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e7a7a680-bca7-4bc2-bd35-5066dd267373 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:50:59.316135 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e7a7a680-bca7-4bc2-bd35-5066dd267373 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:59.323924 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e7a7a680-bca7-4bc2-bd35-5066dd267373 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:59.325412 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e7a7a680-bca7-4bc2-bd35-5066dd267373 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:50:59.326542 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e7a7a680-bca7-4bc2-bd35-5066dd267373 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1721 microversion: 2.20 time: 0.152847 Jun 16 19:50:59.327160 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 518/1060] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:50:59 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:51:00.346251 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-657a6e66-3d37-4bc1-b206-9e9c650fe93c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:00.346840 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-657a6e66-3d37-4bc1-b206-9e9c650fe93c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:00.355403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-657a6e66-3d37-4bc1-b206-9e9c650fe93c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:00.355886 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-657a6e66-3d37-4bc1-b206-9e9c650fe93c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:00.356653 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-657a6e66-3d37-4bc1-b206-9e9c650fe93c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:00.357093 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-657a6e66-3d37-4bc1-b206-9e9c650fe93c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:00.486283 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-657a6e66-3d37-4bc1-b206-9e9c650fe93c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:00.494176 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-657a6e66-3d37-4bc1-b206-9e9c650fe93c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:00.495701 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-657a6e66-3d37-4bc1-b206-9e9c650fe93c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:00.496843 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-657a6e66-3d37-4bc1-b206-9e9c650fe93c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1721 microversion: 2.20 time: 0.155737 Jun 16 19:51:00.497402 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 543/1061] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:00 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:51:01.271521 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-27ccc58e-0f52-4ff2-ab43-46c723d5db2a req-010dd859-1294-465a-b12a-f465084c823c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "763636a9-34c8-47b8-8f39-fdbc2ff40e23", "name": "network-vif-unplugged", "status": "completed", "tag": "6a3e5e5b-38d9-46c6-86d4-f4326eeff1a1"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:51:01.280653 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-27ccc58e-0f52-4ff2-ab43-46c723d5db2a req-010dd859-1294-465a-b12a-f465084c823c service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:01.281095 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-27ccc58e-0f52-4ff2-ab43-46c723d5db2a req-010dd859-1294-465a-b12a-f465084c823c service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:01.292279 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-27ccc58e-0f52-4ff2-ab43-46c723d5db2a req-010dd859-1294-465a-b12a-f465084c823c service nova] Creating event network-vif-unplugged:6a3e5e5b-38d9-46c6-86d4-f4326eeff1a1 for instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 on hv-cinder-84617 Jun 16 19:51:01.297287 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-27ccc58e-0f52-4ff2-ab43-46c723d5db2a req-010dd859-1294-465a-b12a-f465084c823c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029488 Jun 16 19:51:01.297855 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 519/1062] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:51:01.515084 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8724c12e-910f-440a-a561-af9f955cb049 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:01.515698 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8724c12e-910f-440a-a561-af9f955cb049 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:01.518764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=62 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:51:01.523564 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8724c12e-910f-440a-a561-af9f955cb049 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:01.524016 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8724c12e-910f-440a-a561-af9f955cb049 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:01.524777 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8724c12e-910f-440a-a561-af9f955cb049 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:01.525215 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8724c12e-910f-440a-a561-af9f955cb049 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:01.658347 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8724c12e-910f-440a-a561-af9f955cb049 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:01.660151 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8724c12e-910f-440a-a561-af9f955cb049 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:01.661636 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8724c12e-910f-440a-a561-af9f955cb049 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:01.662789 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8724c12e-910f-440a-a561-af9f955cb049 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1724 microversion: 2.20 time: 0.151679 Jun 16 19:51:01.663364 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 544/1063] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:01 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:51:01.680562 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-aae0404b-a71d-40be-a25e-0fd115650e23 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6de9e487-b85f-436d-b2be-556c3408d566"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:51:01.681682 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-aae0404b-a71d-40be-a25e-0fd115650e23 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:01.688337 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aae0404b-a71d-40be-a25e-0fd115650e23 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:01.688780 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aae0404b-a71d-40be-a25e-0fd115650e23 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:01.689527 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aae0404b-a71d-40be-a25e-0fd115650e23 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:01.689956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aae0404b-a71d-40be-a25e-0fd115650e23 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:02.425887 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:51:03.379751 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-aae0404b-a71d-40be-a25e-0fd115650e23 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "POST /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.703403 Jun 16 19:51:03.380374 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 520/1064] 10.222.0.36 () {62 vars in 1363 bytes} [Thu Jun 16 19:51:01 2022] POST /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23/os-volume_attachments => generated 188 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:51:03.491635 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b8bb6e56-e333-481d-88f0-6af0ae0fac99 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:03.492127 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b8bb6e56-e333-481d-88f0-6af0ae0fac99 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:03.498605 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b8bb6e56-e333-481d-88f0-6af0ae0fac99 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:03.499040 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b8bb6e56-e333-481d-88f0-6af0ae0fac99 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:03.499808 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b8bb6e56-e333-481d-88f0-6af0ae0fac99 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:03.500246 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b8bb6e56-e333-481d-88f0-6af0ae0fac99 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:03.575362 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:51:04.283649 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b8bb6e56-e333-481d-88f0-6af0ae0fac99 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "DELETE /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23/os-volume_attachments/6de9e487-b85f-436d-b2be-556c3408d566" status: 202 len: 0 microversion: 2.20 time: 0.796265 Jun 16 19:51:04.284249 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 545/1065] 10.222.0.36 () {60 vars in 1456 bytes} [Thu Jun 16 19:51:03 2022] DELETE /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23/os-volume_attachments/6de9e487-b85f-436d-b2be-556c3408d566 => generated 0 bytes in 798 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:51:04.344882 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-88b86c58-0309-4c22-a4f8-c59391d48bcb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:51:04.345411 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-88b86c58-0309-4c22-a4f8-c59391d48bcb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:04.354289 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-88b86c58-0309-4c22-a4f8-c59391d48bcb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:04.354735 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-88b86c58-0309-4c22-a4f8-c59391d48bcb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:04.355528 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-88b86c58-0309-4c22-a4f8-c59391d48bcb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:04.355964 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-88b86c58-0309-4c22-a4f8-c59391d48bcb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:04.605127 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-88b86c58-0309-4c22-a4f8-c59391d48bcb tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "POST /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23/action" status: 202 len: 0 microversion: 2.20 time: 0.264636 Jun 16 19:51:04.605638 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 521/1066] 10.222.0.36 () {62 vars in 1318 bytes} [Thu Jun 16 19:51:04 2022] POST /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:51:04.613823 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b32325fb-f828-49bf-bfac-f94ff920ad43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:04.614440 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b32325fb-f828-49bf-bfac-f94ff920ad43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:04.621588 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b32325fb-f828-49bf-bfac-f94ff920ad43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:04.622042 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b32325fb-f828-49bf-bfac-f94ff920ad43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:04.622810 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b32325fb-f828-49bf-bfac-f94ff920ad43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:04.623270 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b32325fb-f828-49bf-bfac-f94ff920ad43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:04.758615 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b32325fb-f828-49bf-bfac-f94ff920ad43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:04.772266 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b32325fb-f828-49bf-bfac-f94ff920ad43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:04.774820 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b32325fb-f828-49bf-bfac-f94ff920ad43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:04.776843 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b32325fb-f828-49bf-bfac-f94ff920ad43 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1672 microversion: 2.20 time: 0.166685 Jun 16 19:51:04.777762 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 546/1067] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:04 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:51:05.805175 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4289286a-f1d9-4b86-b76b-425fd11bfeef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:05.805837 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4289286a-f1d9-4b86-b76b-425fd11bfeef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:05.811795 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4289286a-f1d9-4b86-b76b-425fd11bfeef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:05.812241 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4289286a-f1d9-4b86-b76b-425fd11bfeef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:05.813616 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4289286a-f1d9-4b86-b76b-425fd11bfeef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:05.814051 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4289286a-f1d9-4b86-b76b-425fd11bfeef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:05.946406 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4289286a-f1d9-4b86-b76b-425fd11bfeef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:05.954303 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4289286a-f1d9-4b86-b76b-425fd11bfeef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:05.957360 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4289286a-f1d9-4b86-b76b-425fd11bfeef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:05.957360 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4289286a-f1d9-4b86-b76b-425fd11bfeef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1672 microversion: 2.20 time: 0.156156 Jun 16 19:51:05.957584 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 522/1068] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:05 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:51:06.974314 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b1950c13-c918-4bb3-a947-9d2bcb678c14 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:06.974937 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b1950c13-c918-4bb3-a947-9d2bcb678c14 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:06.981398 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b1950c13-c918-4bb3-a947-9d2bcb678c14 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:06.981844 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b1950c13-c918-4bb3-a947-9d2bcb678c14 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:06.982587 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b1950c13-c918-4bb3-a947-9d2bcb678c14 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:06.983054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b1950c13-c918-4bb3-a947-9d2bcb678c14 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:07.121928 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b1950c13-c918-4bb3-a947-9d2bcb678c14 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:07.130121 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b1950c13-c918-4bb3-a947-9d2bcb678c14 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:07.131750 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b1950c13-c918-4bb3-a947-9d2bcb678c14 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:07.132990 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b1950c13-c918-4bb3-a947-9d2bcb678c14 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1730 microversion: 2.20 time: 0.162583 Jun 16 19:51:07.133550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 547/1069] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:06 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:51:08.151508 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-626c8182-3d6e-40c7-940b-bfc388e8b90a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:08.152109 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-626c8182-3d6e-40c7-940b-bfc388e8b90a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:08.158667 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-626c8182-3d6e-40c7-940b-bfc388e8b90a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:08.159154 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-626c8182-3d6e-40c7-940b-bfc388e8b90a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:08.159924 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-626c8182-3d6e-40c7-940b-bfc388e8b90a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:08.160362 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-626c8182-3d6e-40c7-940b-bfc388e8b90a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:08.295839 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-626c8182-3d6e-40c7-940b-bfc388e8b90a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:08.304238 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-626c8182-3d6e-40c7-940b-bfc388e8b90a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:08.305731 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-626c8182-3d6e-40c7-940b-bfc388e8b90a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:08.306879 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-626c8182-3d6e-40c7-940b-bfc388e8b90a tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1730 microversion: 2.20 time: 0.159302 Jun 16 19:51:08.307463 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 523/1070] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:08 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:51:09.325678 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7339df81-462c-47ca-9aa0-2291946eb2a7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:09.326287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-7339df81-462c-47ca-9aa0-2291946eb2a7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:09.332531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7339df81-462c-47ca-9aa0-2291946eb2a7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:09.332979 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7339df81-462c-47ca-9aa0-2291946eb2a7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:09.333737 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7339df81-462c-47ca-9aa0-2291946eb2a7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:09.334170 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7339df81-462c-47ca-9aa0-2291946eb2a7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:09.469742 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-7339df81-462c-47ca-9aa0-2291946eb2a7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:09.479624 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-7339df81-462c-47ca-9aa0-2291946eb2a7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:09.481375 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-7339df81-462c-47ca-9aa0-2291946eb2a7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:09.483511 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-7339df81-462c-47ca-9aa0-2291946eb2a7 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1730 microversion: 2.20 time: 0.161857 Jun 16 19:51:09.484633 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 548/1071] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:09 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:51:10.183536 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2e94be39-34f5-4431-97e6-d3cbde39e134 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:10.184132 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2e94be39-34f5-4431-97e6-d3cbde39e134 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:10.191090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e94be39-34f5-4431-97e6-d3cbde39e134 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:10.191536 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e94be39-34f5-4431-97e6-d3cbde39e134 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:10.202141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e94be39-34f5-4431-97e6-d3cbde39e134 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:10.202141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e94be39-34f5-4431-97e6-d3cbde39e134 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:10.216125 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2e94be39-34f5-4431-97e6-d3cbde39e134 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42/ips" status: 200 len: 150 microversion: 2.1 time: 0.036395 Jun 16 19:51:10.216964 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 524/1072] 10.222.0.36 () {58 vars in 1247 bytes} [Thu Jun 16 19:51:10 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:51:10.501579 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3538bff2-7bcf-4a9e-9d00-7e55071ea453 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:10.502186 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-3538bff2-7bcf-4a9e-9d00-7e55071ea453 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:10.508543 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3538bff2-7bcf-4a9e-9d00-7e55071ea453 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:10.512660 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3538bff2-7bcf-4a9e-9d00-7e55071ea453 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:10.512660 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3538bff2-7bcf-4a9e-9d00-7e55071ea453 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:10.512660 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3538bff2-7bcf-4a9e-9d00-7e55071ea453 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:10.642312 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3538bff2-7bcf-4a9e-9d00-7e55071ea453 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:10.652273 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3538bff2-7bcf-4a9e-9d00-7e55071ea453 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:10.654108 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3538bff2-7bcf-4a9e-9d00-7e55071ea453 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:10.655671 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-3538bff2-7bcf-4a9e-9d00-7e55071ea453 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1730 microversion: 2.20 time: 0.157898 Jun 16 19:51:10.656446 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 549/1073] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:10 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:51:11.676049 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ce7029dd-4621-4d49-9f9a-f1a66bdad27f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:11.676807 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ce7029dd-4621-4d49-9f9a-f1a66bdad27f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:11.683674 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ce7029dd-4621-4d49-9f9a-f1a66bdad27f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:11.684125 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ce7029dd-4621-4d49-9f9a-f1a66bdad27f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:11.685064 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ce7029dd-4621-4d49-9f9a-f1a66bdad27f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:11.685497 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ce7029dd-4621-4d49-9f9a-f1a66bdad27f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:11.831852 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ce7029dd-4621-4d49-9f9a-f1a66bdad27f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:11.842033 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ce7029dd-4621-4d49-9f9a-f1a66bdad27f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:11.844325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ce7029dd-4621-4d49-9f9a-f1a66bdad27f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:11.845910 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ce7029dd-4621-4d49-9f9a-f1a66bdad27f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1730 microversion: 2.20 time: 0.174319 Jun 16 19:51:11.846961 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 525/1074] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:11 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:51:11.930556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b6abf361-6e98-4ce2-830d-943247e39122 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f3da324-e936-4751-afbd-4f1babddac35"}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:51:11.934019 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b6abf361-6e98-4ce2-830d-943247e39122 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:11.938945 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b6abf361-6e98-4ce2-830d-943247e39122 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:11.939421 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b6abf361-6e98-4ce2-830d-943247e39122 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:11.940188 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b6abf361-6e98-4ce2-830d-943247e39122 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:11.940630 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b6abf361-6e98-4ce2-830d-943247e39122 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:12.865581 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c965c5da-73a6-4bea-bc1c-101fcd898b5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:12.866917 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c965c5da-73a6-4bea-bc1c-101fcd898b5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:12.874792 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c965c5da-73a6-4bea-bc1c-101fcd898b5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:12.875911 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c965c5da-73a6-4bea-bc1c-101fcd898b5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:12.876810 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c965c5da-73a6-4bea-bc1c-101fcd898b5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:12.877338 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c965c5da-73a6-4bea-bc1c-101fcd898b5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:13.290818 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c965c5da-73a6-4bea-bc1c-101fcd898b5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:13.300082 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c965c5da-73a6-4bea-bc1c-101fcd898b5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:13.301699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c965c5da-73a6-4bea-bc1c-101fcd898b5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:13.302964 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c965c5da-73a6-4bea-bc1c-101fcd898b5e tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1730 microversion: 2.20 time: 0.442157 Jun 16 19:51:13.303610 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 526/1075] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:12 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1730 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:51:14.323132 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a993eebe-c796-45c3-a94a-fe692e900acf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:14.323848 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a993eebe-c796-45c3-a94a-fe692e900acf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:14.330001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a993eebe-c796-45c3-a94a-fe692e900acf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:14.330455 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a993eebe-c796-45c3-a94a-fe692e900acf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:14.331276 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a993eebe-c796-45c3-a94a-fe692e900acf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:14.331715 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a993eebe-c796-45c3-a94a-fe692e900acf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:14.491159 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a993eebe-c796-45c3-a94a-fe692e900acf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:14.504142 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a993eebe-c796-45c3-a94a-fe692e900acf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:14.505862 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a993eebe-c796-45c3-a94a-fe692e900acf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:14.507118 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a993eebe-c796-45c3-a94a-fe692e900acf tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1730 microversion: 2.20 time: 0.188766 Jun 16 19:51:14.507657 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 527/1076] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:14 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:51:15.525567 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-76e9cda9-0e27-4e70-b8ba-edbea4180d6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:15.526251 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-76e9cda9-0e27-4e70-b8ba-edbea4180d6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:15.533177 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-76e9cda9-0e27-4e70-b8ba-edbea4180d6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:15.533423 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-76e9cda9-0e27-4e70-b8ba-edbea4180d6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:15.534148 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-76e9cda9-0e27-4e70-b8ba-edbea4180d6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:15.534760 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-76e9cda9-0e27-4e70-b8ba-edbea4180d6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:15.685569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-76e9cda9-0e27-4e70-b8ba-edbea4180d6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:15.694322 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-76e9cda9-0e27-4e70-b8ba-edbea4180d6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:15.695838 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-76e9cda9-0e27-4e70-b8ba-edbea4180d6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:15.697048 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-76e9cda9-0e27-4e70-b8ba-edbea4180d6f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1730 microversion: 2.20 time: 0.175329 Jun 16 19:51:15.697606 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 528/1077] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:15 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:51:16.715537 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8eb6c881-8030-47b2-9d1c-45a9134b5432 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:16.716383 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8eb6c881-8030-47b2-9d1c-45a9134b5432 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:16.723154 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8eb6c881-8030-47b2-9d1c-45a9134b5432 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:16.723631 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8eb6c881-8030-47b2-9d1c-45a9134b5432 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:16.724396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8eb6c881-8030-47b2-9d1c-45a9134b5432 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:16.724834 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8eb6c881-8030-47b2-9d1c-45a9134b5432 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:16.861628 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8eb6c881-8030-47b2-9d1c-45a9134b5432 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:16.871154 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8eb6c881-8030-47b2-9d1c-45a9134b5432 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:16.872693 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8eb6c881-8030-47b2-9d1c-45a9134b5432 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:16.873896 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8eb6c881-8030-47b2-9d1c-45a9134b5432 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1730 microversion: 2.20 time: 0.162384 Jun 16 19:51:16.878958 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 529/1078] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:16 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:51:17.892832 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3959740c-1f26-4f0c-85b2-dc7eb490083b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:17.893520 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3959740c-1f26-4f0c-85b2-dc7eb490083b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:17.900266 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3959740c-1f26-4f0c-85b2-dc7eb490083b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:17.917738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3959740c-1f26-4f0c-85b2-dc7eb490083b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:17.917738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3959740c-1f26-4f0c-85b2-dc7eb490083b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:17.917738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3959740c-1f26-4f0c-85b2-dc7eb490083b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:18.043511 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3959740c-1f26-4f0c-85b2-dc7eb490083b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:18.051312 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3959740c-1f26-4f0c-85b2-dc7eb490083b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:18.052955 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3959740c-1f26-4f0c-85b2-dc7eb490083b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:18.054432 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3959740c-1f26-4f0c-85b2-dc7eb490083b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1730 microversion: 2.20 time: 0.166328 Jun 16 19:51:18.055008 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 530/1079] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:17 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:51:19.074059 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-86c839d8-672e-44cc-871c-9afe40821556 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:19.074760 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-86c839d8-672e-44cc-871c-9afe40821556 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:19.081100 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86c839d8-672e-44cc-871c-9afe40821556 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:19.081544 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86c839d8-672e-44cc-871c-9afe40821556 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:19.082296 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86c839d8-672e-44cc-871c-9afe40821556 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:19.082734 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86c839d8-672e-44cc-871c-9afe40821556 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:19.215990 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-86c839d8-672e-44cc-871c-9afe40821556 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:19.224623 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-86c839d8-672e-44cc-871c-9afe40821556 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:19.226148 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-86c839d8-672e-44cc-871c-9afe40821556 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:19.227319 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-86c839d8-672e-44cc-871c-9afe40821556 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1730 microversion: 2.20 time: 0.157318 Jun 16 19:51:19.227865 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 531/1080] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:19 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:51:20.244932 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-59d59aaa-adad-403f-9091-7227fac92f9f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:20.245598 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-59d59aaa-adad-403f-9091-7227fac92f9f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:20.252719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-59d59aaa-adad-403f-9091-7227fac92f9f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:20.253172 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-59d59aaa-adad-403f-9091-7227fac92f9f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:20.254011 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-59d59aaa-adad-403f-9091-7227fac92f9f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:20.254447 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-59d59aaa-adad-403f-9091-7227fac92f9f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:20.344517 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b6abf361-6e98-4ce2-830d-943247e39122 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "POST /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.417633 Jun 16 19:51:20.349186 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 550/1081] 10.222.0.36 () {60 vars in 1322 bytes} [Thu Jun 16 19:51:11 2022] POST /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42/os-volume_attachments => generated 194 bytes in 8419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:51:20.386238 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-59d59aaa-adad-403f-9091-7227fac92f9f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:20.395105 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-59d59aaa-adad-403f-9091-7227fac92f9f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:20.396579 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-59d59aaa-adad-403f-9091-7227fac92f9f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:20.397785 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-59d59aaa-adad-403f-9091-7227fac92f9f tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1730 microversion: 2.20 time: 0.156576 Jun 16 19:51:20.398492 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 532/1082] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:20 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:51:21.416339 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b6152fcf-08fc-4624-8479-03d83c8560ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:21.417192 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b6152fcf-08fc-4624-8479-03d83c8560ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:21.423433 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b6152fcf-08fc-4624-8479-03d83c8560ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:21.423952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b6152fcf-08fc-4624-8479-03d83c8560ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:21.424788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b6152fcf-08fc-4624-8479-03d83c8560ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:21.425311 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b6152fcf-08fc-4624-8479-03d83c8560ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:21.559838 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b6152fcf-08fc-4624-8479-03d83c8560ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:21.568491 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b6152fcf-08fc-4624-8479-03d83c8560ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:21.569986 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b6152fcf-08fc-4624-8479-03d83c8560ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:21.571174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b6152fcf-08fc-4624-8479-03d83c8560ef tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1730 microversion: 2.20 time: 0.160004 Jun 16 19:51:21.571722 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 551/1083] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:21 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:51:22.589283 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b71857ad-11f1-4689-bead-e663393df2fe tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:22.589879 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b71857ad-11f1-4689-bead-e663393df2fe tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:22.596768 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b71857ad-11f1-4689-bead-e663393df2fe tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:22.597209 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b71857ad-11f1-4689-bead-e663393df2fe tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:22.597956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b71857ad-11f1-4689-bead-e663393df2fe tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:22.598387 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b71857ad-11f1-4689-bead-e663393df2fe tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:22.729278 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b71857ad-11f1-4689-bead-e663393df2fe tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:22.737065 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b71857ad-11f1-4689-bead-e663393df2fe tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:22.738558 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b71857ad-11f1-4689-bead-e663393df2fe tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:22.739761 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b71857ad-11f1-4689-bead-e663393df2fe tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1730 microversion: 2.20 time: 0.154262 Jun 16 19:51:22.740316 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 533/1084] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:22 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:51:23.451649 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-f355ea76-36fb-447b-b189-851226aa83cd req-b17690bf-363b-453d-bc6f-ded0eb4b6782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "763636a9-34c8-47b8-8f39-fdbc2ff40e23", "name": "network-vif-plugged", "status": "completed", "tag": "6a3e5e5b-38d9-46c6-86d4-f4326eeff1a1"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:51:23.460681 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-f355ea76-36fb-447b-b189-851226aa83cd req-b17690bf-363b-453d-bc6f-ded0eb4b6782 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:23.461137 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-f355ea76-36fb-447b-b189-851226aa83cd req-b17690bf-363b-453d-bc6f-ded0eb4b6782 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:23.472384 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-f355ea76-36fb-447b-b189-851226aa83cd req-b17690bf-363b-453d-bc6f-ded0eb4b6782 service nova] Creating event network-vif-plugged:6a3e5e5b-38d9-46c6-86d4-f4326eeff1a1 for instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 on hv-cinder-84617 Jun 16 19:51:23.477663 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-f355ea76-36fb-447b-b189-851226aa83cd req-b17690bf-363b-453d-bc6f-ded0eb4b6782 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029671 Jun 16 19:51:23.478219 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 552/1085] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:51:23.781587 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f489282a-e660-4f90-9516-e7beb16c6509 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:23.781587 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f489282a-e660-4f90-9516-e7beb16c6509 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:23.781587 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f489282a-e660-4f90-9516-e7beb16c6509 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:23.781587 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f489282a-e660-4f90-9516-e7beb16c6509 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:23.782616 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f489282a-e660-4f90-9516-e7beb16c6509 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:23.782616 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f489282a-e660-4f90-9516-e7beb16c6509 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:23.904318 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f489282a-e660-4f90-9516-e7beb16c6509 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:23.908418 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:51:23.913311 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f489282a-e660-4f90-9516-e7beb16c6509 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:23.914939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f489282a-e660-4f90-9516-e7beb16c6509 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:23.916157 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f489282a-e660-4f90-9516-e7beb16c6509 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1730 microversion: 2.20 time: 0.162149 Jun 16 19:51:23.916748 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 534/1086] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:23 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:51:24.936654 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-96d51fb4-a66c-411a-a8ff-4548a4fbb192 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:24.937342 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-96d51fb4-a66c-411a-a8ff-4548a4fbb192 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:24.943738 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-96d51fb4-a66c-411a-a8ff-4548a4fbb192 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:24.944183 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-96d51fb4-a66c-411a-a8ff-4548a4fbb192 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:24.944935 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-96d51fb4-a66c-411a-a8ff-4548a4fbb192 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:24.945366 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-96d51fb4-a66c-411a-a8ff-4548a4fbb192 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:25.072318 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-96d51fb4-a66c-411a-a8ff-4548a4fbb192 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:25.080681 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-96d51fb4-a66c-411a-a8ff-4548a4fbb192 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:25.082160 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-96d51fb4-a66c-411a-a8ff-4548a4fbb192 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:25.083333 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-96d51fb4-a66c-411a-a8ff-4548a4fbb192 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1730 microversion: 2.20 time: 0.151428 Jun 16 19:51:25.083884 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 553/1087] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:24 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:51:26.101861 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-165f4b00-79d4-4b1d-a2d2-1336f6f05a44 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:26.107782 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-165f4b00-79d4-4b1d-a2d2-1336f6f05a44 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:26.110302 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-165f4b00-79d4-4b1d-a2d2-1336f6f05a44 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:26.110753 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-165f4b00-79d4-4b1d-a2d2-1336f6f05a44 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:26.111542 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-165f4b00-79d4-4b1d-a2d2-1336f6f05a44 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:26.111978 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-165f4b00-79d4-4b1d-a2d2-1336f6f05a44 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:26.242163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-165f4b00-79d4-4b1d-a2d2-1336f6f05a44 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:26.249976 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-165f4b00-79d4-4b1d-a2d2-1336f6f05a44 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:26.251497 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-165f4b00-79d4-4b1d-a2d2-1336f6f05a44 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:26.252647 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-165f4b00-79d4-4b1d-a2d2-1336f6f05a44 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1730 microversion: 2.20 time: 0.154777 Jun 16 19:51:26.253194 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 535/1088] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:26 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:51:27.278273 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d4b32f5c-d37f-4c31-ba9a-03722047d891 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:27.279477 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d4b32f5c-d37f-4c31-ba9a-03722047d891 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:27.290381 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d4b32f5c-d37f-4c31-ba9a-03722047d891 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:27.290838 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d4b32f5c-d37f-4c31-ba9a-03722047d891 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:27.291654 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d4b32f5c-d37f-4c31-ba9a-03722047d891 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:27.292099 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d4b32f5c-d37f-4c31-ba9a-03722047d891 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:27.430808 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d4b32f5c-d37f-4c31-ba9a-03722047d891 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:27.439402 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d4b32f5c-d37f-4c31-ba9a-03722047d891 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:27.441141 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d4b32f5c-d37f-4c31-ba9a-03722047d891 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:27.442293 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d4b32f5c-d37f-4c31-ba9a-03722047d891 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1730 microversion: 2.20 time: 0.171610 Jun 16 19:51:27.442852 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 554/1089] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:27 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:51:28.459816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-06819bb4-4555-4c07-92dd-30e3f4269053 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:28.460370 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-06819bb4-4555-4c07-92dd-30e3f4269053 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:28.466767 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-06819bb4-4555-4c07-92dd-30e3f4269053 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:28.467255 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-06819bb4-4555-4c07-92dd-30e3f4269053 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:28.468008 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-06819bb4-4555-4c07-92dd-30e3f4269053 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:28.468439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-06819bb4-4555-4c07-92dd-30e3f4269053 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:28.592161 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-06819bb4-4555-4c07-92dd-30e3f4269053 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:28.600238 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-06819bb4-4555-4c07-92dd-30e3f4269053 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:28.601751 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-06819bb4-4555-4c07-92dd-30e3f4269053 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:28.602905 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-06819bb4-4555-4c07-92dd-30e3f4269053 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1717 microversion: 2.20 time: 0.147088 Jun 16 19:51:28.603478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 536/1090] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:51:28 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1717 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:51:28.998736 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9317b98b-39d4-4a2b-a7a0-70c14872d81e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:28.999296 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9317b98b-39d4-4a2b-a7a0-70c14872d81e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:29.005864 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9317b98b-39d4-4a2b-a7a0-70c14872d81e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:29.006319 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9317b98b-39d4-4a2b-a7a0-70c14872d81e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:29.007143 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9317b98b-39d4-4a2b-a7a0-70c14872d81e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:29.007583 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9317b98b-39d4-4a2b-a7a0-70c14872d81e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:29.086019 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-9317b98b-39d4-4a2b-a7a0-70c14872d81e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lazy-loading 'services' on Instance uuid f9a044da-c83d-4141-bb87-82809c1b7f42 {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:51:29.350429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9317b98b-39d4-4a2b-a7a0-70c14872d81e tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42/os-volume_attachments/7f3da324-e936-4751-afbd-4f1babddac35" status: 202 len: 0 microversion: 2.1 time: 0.355245 Jun 16 19:51:29.351066 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 555/1091] 10.222.0.36 () {58 vars in 1415 bytes} [Thu Jun 16 19:51:28 2022] DELETE /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42/os-volume_attachments/7f3da324-e936-4751-afbd-4f1babddac35 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:51:29.359399 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6733c327-336d-4ebd-8ed1-eb8b65aaae1c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:29.360487 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6733c327-336d-4ebd-8ed1-eb8b65aaae1c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:29.362356 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=42 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:51:29.367165 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6733c327-336d-4ebd-8ed1-eb8b65aaae1c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:29.367615 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6733c327-336d-4ebd-8ed1-eb8b65aaae1c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:29.368383 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6733c327-336d-4ebd-8ed1-eb8b65aaae1c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:29.368833 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6733c327-336d-4ebd-8ed1-eb8b65aaae1c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:29.397478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6733c327-336d-4ebd-8ed1-eb8b65aaae1c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042124 Jun 16 19:51:29.398018 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 537/1092] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:51:29 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:51:30.410815 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9bbbaae5-0e1d-4fad-8b29-f075bb53e550 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:30.411926 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9bbbaae5-0e1d-4fad-8b29-f075bb53e550 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:30.418109 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9bbbaae5-0e1d-4fad-8b29-f075bb53e550 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:30.418553 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9bbbaae5-0e1d-4fad-8b29-f075bb53e550 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:30.419454 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9bbbaae5-0e1d-4fad-8b29-f075bb53e550 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:30.419890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9bbbaae5-0e1d-4fad-8b29-f075bb53e550 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:30.448680 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9bbbaae5-0e1d-4fad-8b29-f075bb53e550 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043323 Jun 16 19:51:30.449220 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 556/1093] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:51:30 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:51:31.461443 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3cf71946-0383-4480-85a8-85a558d6c6f3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:31.462333 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3cf71946-0383-4480-85a8-85a558d6c6f3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:31.469173 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3cf71946-0383-4480-85a8-85a558d6c6f3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:31.469622 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3cf71946-0383-4480-85a8-85a558d6c6f3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:31.470381 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3cf71946-0383-4480-85a8-85a558d6c6f3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:31.470814 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3cf71946-0383-4480-85a8-85a558d6c6f3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:31.498827 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3cf71946-0383-4480-85a8-85a558d6c6f3 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041812 Jun 16 19:51:31.499417 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 538/1094] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:51:31 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:51:31.559541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-51bfd9c8-f1ab-4607-ad80-51109e6fb844 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:31.560047 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-51bfd9c8-f1ab-4607-ad80-51109e6fb844 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:31.566622 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-51bfd9c8-f1ab-4607-ad80-51109e6fb844 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:31.567116 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-51bfd9c8-f1ab-4607-ad80-51109e6fb844 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:31.567872 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-51bfd9c8-f1ab-4607-ad80-51109e6fb844 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:31.568307 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-51bfd9c8-f1ab-4607-ad80-51109e6fb844 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:31.592774 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-51bfd9c8-f1ab-4607-ad80-51109e6fb844 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Going to try to terminate instance {{(pid=124551) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:51:31.623743 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:51:32.059698 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-51bfd9c8-f1ab-4607-ad80-51109e6fb844 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 204 len: 0 microversion: 2.1 time: 0.503589 Jun 16 19:51:32.060306 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 557/1095] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:51:31 2022] DELETE /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:51:32.069145 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b1a786c1-3f48-4ede-9829-05220cdca668 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:32.069787 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b1a786c1-3f48-4ede-9829-05220cdca668 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:32.075712 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b1a786c1-3f48-4ede-9829-05220cdca668 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:32.076164 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b1a786c1-3f48-4ede-9829-05220cdca668 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:32.076930 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b1a786c1-3f48-4ede-9829-05220cdca668 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:32.077953 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b1a786c1-3f48-4ede-9829-05220cdca668 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:32.209946 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b1a786c1-3f48-4ede-9829-05220cdca668 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:32.217370 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b1a786c1-3f48-4ede-9829-05220cdca668 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 200 len: 1682 microversion: 2.1 time: 0.152286 Jun 16 19:51:32.217957 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 539/1096] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:32 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:51:33.235037 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3fb3d82b-02cf-49e8-919c-bc941107ef94 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:33.235743 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-3fb3d82b-02cf-49e8-919c-bc941107ef94 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:33.242364 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3fb3d82b-02cf-49e8-919c-bc941107ef94 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:33.242815 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3fb3d82b-02cf-49e8-919c-bc941107ef94 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:33.243615 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3fb3d82b-02cf-49e8-919c-bc941107ef94 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:33.244048 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3fb3d82b-02cf-49e8-919c-bc941107ef94 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:33.370839 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3fb3d82b-02cf-49e8-919c-bc941107ef94 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:33.378290 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-3fb3d82b-02cf-49e8-919c-bc941107ef94 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 200 len: 1682 microversion: 2.1 time: 0.147481 Jun 16 19:51:33.378837 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 558/1097] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:33 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:51:34.395443 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-08b174f2-05f3-4079-a0a0-e3e1ec8e11ba tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:34.396018 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-08b174f2-05f3-4079-a0a0-e3e1ec8e11ba tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:34.402998 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-08b174f2-05f3-4079-a0a0-e3e1ec8e11ba tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:34.403450 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-08b174f2-05f3-4079-a0a0-e3e1ec8e11ba tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:34.404238 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-08b174f2-05f3-4079-a0a0-e3e1ec8e11ba tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:34.404650 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-08b174f2-05f3-4079-a0a0-e3e1ec8e11ba tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:34.541523 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-08b174f2-05f3-4079-a0a0-e3e1ec8e11ba tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:34.549589 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-08b174f2-05f3-4079-a0a0-e3e1ec8e11ba tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 200 len: 1682 microversion: 2.1 time: 0.158005 Jun 16 19:51:34.550408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 540/1098] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:34 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:51:35.171917 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-1e71db58-9cc2-4cf3-917b-32b6cae5c022 req-739cc5dd-170c-4d1e-b10e-8534997e1b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a044da-c83d-4141-bb87-82809c1b7f42", "name": "network-vif-deleted", "tag": "37674fcb-245a-4781-836c-6ae3cfe123bc"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:51:35.176578 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:51:35.181993 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-1e71db58-9cc2-4cf3-917b-32b6cae5c022 req-739cc5dd-170c-4d1e-b10e-8534997e1b33 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:35.182499 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-1e71db58-9cc2-4cf3-917b-32b6cae5c022 req-739cc5dd-170c-4d1e-b10e-8534997e1b33 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:35.194603 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-1e71db58-9cc2-4cf3-917b-32b6cae5c022 req-739cc5dd-170c-4d1e-b10e-8534997e1b33 service nova] Creating event network-vif-deleted:37674fcb-245a-4781-836c-6ae3cfe123bc for instance f9a044da-c83d-4141-bb87-82809c1b7f42 on hv-cinder-84617 Jun 16 19:51:35.199598 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-1e71db58-9cc2-4cf3-917b-32b6cae5c022 req-739cc5dd-170c-4d1e-b10e-8534997e1b33 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032989 Jun 16 19:51:35.200171 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 559/1099] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:51:35.567044 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6e13615e-5114-4312-86f7-805b0eb5d790 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:35.568211 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6e13615e-5114-4312-86f7-805b0eb5d790 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:35.574661 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6e13615e-5114-4312-86f7-805b0eb5d790 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:35.575159 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6e13615e-5114-4312-86f7-805b0eb5d790 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:35.575919 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6e13615e-5114-4312-86f7-805b0eb5d790 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:35.576397 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6e13615e-5114-4312-86f7-805b0eb5d790 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:35.609632 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6e13615e-5114-4312-86f7-805b0eb5d790 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:35.610080 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6e13615e-5114-4312-86f7-805b0eb5d790 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:35.610529 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-6e13615e-5114-4312-86f7-805b0eb5d790 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lazy-loading 'fault' on Instance uuid f9a044da-c83d-4141-bb87-82809c1b7f42 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:51:35.650538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6e13615e-5114-4312-86f7-805b0eb5d790 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df05cbf303c4524a665b429f240a17a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4ab888dd74218ab5d7812ad095371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:51:35.659433 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6e13615e-5114-4312-86f7-805b0eb5d790 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 200 len: 1331 microversion: 2.1 time: 0.096370 Jun 16 19:51:35.660981 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 541/1100] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:35 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:51:36.678880 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b804d4a0-7c9a-442e-b28f-4acde62703b4 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:36.679594 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b804d4a0-7c9a-442e-b28f-4acde62703b4 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:36.686276 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b804d4a0-7c9a-442e-b28f-4acde62703b4 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:36.686715 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b804d4a0-7c9a-442e-b28f-4acde62703b4 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:36.687497 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b804d4a0-7c9a-442e-b28f-4acde62703b4 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:36.687927 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b804d4a0-7c9a-442e-b28f-4acde62703b4 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:36.703881 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-b804d4a0-7c9a-442e-b28f-4acde62703b4 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] HTTP exception thrown: Instance f9a044da-c83d-4141-bb87-82809c1b7f42 could not be found. Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b804d4a0-7c9a-442e-b28f-4acde62703b4 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Request method failure captured: Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 HTTP/1.1 Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4fyBPW6I9Gw6XK8Mc3wtez0zYsc4UrjgW7z4WtApzgBYkrjjskhl3gYkWnE6yWJE5ICrDHXLgUYO-0AGzBAc7qg6XibMR0r_JEUP5LVfGl7WyQCTm5mkF0v4IWKdbz7Ao2NSIM42ZaaFkj5iXJmRir4voVV15buKmDOb_Ti4CHFnHY Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:51:36.705537 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:51:36.707243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47a4ab888dd74218ab5d7812ad095371", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:51:36.707243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:36.707243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:51:36.707243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:36.707243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:51:36.707243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:51:36.707243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:51:36.707243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 4df05cbf303c4524a665b429f240a17a Jun 16 19:51:36.707243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:51:36.707243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:51:36.707243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance f9a044da-c83d-4141-bb87-82809c1b7f42 could not be found. Jun 16 19:51:36.707243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': 'f9a044da-c83d-4141-bb87-82809c1b7f42'} Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9a044da-c83d-4141-bb87-82809c1b7f42 could not be found. Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:51:36.708120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:51:36.709518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:51:36.709518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:51:36.709518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:51:36.709518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:51:36.709518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:51:36.709518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:51:36.709518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:51:36.709518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9a044da-c83d-4141-bb87-82809c1b7f42 could not be found. Jun 16 19:51:36.709518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:36.709518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:36.709518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:36.709518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:36.709518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:36.709518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:36.709518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:51:36.709518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:51:36.709518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9a044da-c83d-4141-bb87-82809c1b7f42 could not be found. Jun 16 19:51:36.709518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:36.710676 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b804d4a0-7c9a-442e-b28f-4acde62703b4 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Returning 404 to user: Instance f9a044da-c83d-4141-bb87-82809c1b7f42 could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:51:36.710676 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b804d4a0-7c9a-442e-b28f-4acde62703b4 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 404 len: 111 microversion: 2.1 time: 0.033486 Jun 16 19:51:36.710839 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 560/1101] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:36 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:51:36.715842 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f8a6cee2-f01a-42c4-b759-c828249860d4 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '.version_select at 0x7f0505c915e0>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:36.849471 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f8a6cee2-f01a-42c4-b759-c828249860d4 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767771537" status: 202 len: 0 microversion: 2.1 time: 0.137289 Jun 16 19:51:36.850038 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 542/1102] 10.222.0.36 () {58 vars in 1220 bytes} [Thu Jun 16 19:51:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767771537 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:51:38.993844 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-257f80bc-985f-420f-933f-d11b3870e068 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:38.994365 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-257f80bc-985f-420f-933f-d11b3870e068 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:39.001059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-257f80bc-985f-420f-933f-d11b3870e068 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:39.001506 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-257f80bc-985f-420f-933f-d11b3870e068 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:39.002260 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-257f80bc-985f-420f-933f-d11b3870e068 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:39.002690 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-257f80bc-985f-420f-933f-d11b3870e068 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:39.015777 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-257f80bc-985f-420f-933f-d11b3870e068 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] HTTP exception thrown: Instance f9a044da-c83d-4141-bb87-82809c1b7f42 could not be found. Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-257f80bc-985f-420f-933f-d11b3870e068 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Request method failure captured: Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: DELETE /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 HTTP/1.1 Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4fyBPW6I9Gw6XK8Mc3wtez0zYsc4UrjgW7z4WtApzgBYkrjjskhl3gYkWnE6yWJE5ICrDHXLgUYO-0AGzBAc7qg6XibMR0r_JEUP5LVfGl7WyQCTm5mkF0v4IWKdbz7Ao2NSIM42ZaaFkj5iXJmRir4voVV15buKmDOb_Ti4CHFnHY Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:51:39.017305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:51:39.018897 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47a4ab888dd74218ab5d7812ad095371", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:51:39.018897 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:39.018897 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:51:39.018897 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:39.018897 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:51:39.018897 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:51:39.018897 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:51:39.018897 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 4df05cbf303c4524a665b429f240a17a Jun 16 19:51:39.018897 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:51:39.018897 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:51:39.018897 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance f9a044da-c83d-4141-bb87-82809c1b7f42 could not be found. Jun 16 19:51:39.018897 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': 'f9a044da-c83d-4141-bb87-82809c1b7f42'} Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9a044da-c83d-4141-bb87-82809c1b7f42 could not be found. Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:51:39.019788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9a044da-c83d-4141-bb87-82809c1b7f42 could not be found. Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9a044da-c83d-4141-bb87-82809c1b7f42 could not be found. Jun 16 19:51:39.021240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:39.022989 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-257f80bc-985f-420f-933f-d11b3870e068 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Returning 404 to user: Instance f9a044da-c83d-4141-bb87-82809c1b7f42 could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:51:39.022989 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-257f80bc-985f-420f-933f-d11b3870e068 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 404 len: 111 microversion: 2.1 time: 0.028675 Jun 16 19:51:39.022989 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 561/1103] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:51:38 2022] DELETE /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:51:39.027570 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b3e39668-5741-49d0-96a7-978d81e2a21f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:39.028182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b3e39668-5741-49d0-96a7-978d81e2a21f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: f9a044da-c83d-4141-bb87-82809c1b7f42] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:39.035193 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b3e39668-5741-49d0-96a7-978d81e2a21f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:39.035640 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b3e39668-5741-49d0-96a7-978d81e2a21f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:39.036396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b3e39668-5741-49d0-96a7-978d81e2a21f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:39.036833 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b3e39668-5741-49d0-96a7-978d81e2a21f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:39.049891 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-b3e39668-5741-49d0-96a7-978d81e2a21f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] HTTP exception thrown: Instance f9a044da-c83d-4141-bb87-82809c1b7f42 could not be found. Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b3e39668-5741-49d0-96a7-978d81e2a21f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Request method failure captured: Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 HTTP/1.1 Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4fyBPW6I9Gw6XK8Mc3wtez0zYsc4UrjgW7z4WtApzgBYkrjjskhl3gYkWnE6yWJE5ICrDHXLgUYO-0AGzBAc7qg6XibMR0r_JEUP5LVfGl7WyQCTm5mkF0v4IWKdbz7Ao2NSIM42ZaaFkj5iXJmRir4voVV15buKmDOb_Ti4CHFnHY Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:51:39.051526 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:51:39.053091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47a4ab888dd74218ab5d7812ad095371", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:51:39.053091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:39.053091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:51:39.053091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:39.053091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:51:39.053091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:51:39.053091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:51:39.053091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 4df05cbf303c4524a665b429f240a17a Jun 16 19:51:39.053091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:51:39.053091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:51:39.053091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance f9a044da-c83d-4141-bb87-82809c1b7f42 could not be found. Jun 16 19:51:39.053091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': 'f9a044da-c83d-4141-bb87-82809c1b7f42'} Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9a044da-c83d-4141-bb87-82809c1b7f42 could not be found. Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:51:39.054026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:51:39.055530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:51:39.055530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:51:39.055530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:51:39.055530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:51:39.055530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:51:39.055530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:51:39.055530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:51:39.055530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9a044da-c83d-4141-bb87-82809c1b7f42 could not be found. Jun 16 19:51:39.055530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:39.055530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:39.055530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:39.055530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:39.055530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:39.055530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:39.055530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:51:39.055530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:51:39.055530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9a044da-c83d-4141-bb87-82809c1b7f42 could not be found. Jun 16 19:51:39.055530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:39.057110 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b3e39668-5741-49d0-96a7-978d81e2a21f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Returning 404 to user: Instance f9a044da-c83d-4141-bb87-82809c1b7f42 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:51:39.057110 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b3e39668-5741-49d0-96a7-978d81e2a21f tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42" status: 404 len: 111 microversion: 2.1 time: 0.029624 Jun 16 19:51:39.057110 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 543/1104] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:39 2022] GET /compute/v2.1/servers/f9a044da-c83d-4141-bb87-82809c1b7f42 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:51:40.347308 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c0471189-8232-40a1-aa5a-f36a36ade09b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:40.347802 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c0471189-8232-40a1-aa5a-f36a36ade09b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:40.354326 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c0471189-8232-40a1-aa5a-f36a36ade09b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:40.354789 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c0471189-8232-40a1-aa5a-f36a36ade09b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:40.355583 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c0471189-8232-40a1-aa5a-f36a36ade09b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:40.356148 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c0471189-8232-40a1-aa5a-f36a36ade09b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:40.370340 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-c0471189-8232-40a1-aa5a-f36a36ade09b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] HTTP exception thrown: Instance b5581fbe-6950-4ade-86e0-a1fa41b436ca could not be found. Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c0471189-8232-40a1-aa5a-f36a36ade09b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Request method failure captured: Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: DELETE /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca HTTP/1.1 Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4fyBPW6I9Gw6XK8Mc3wtez0zYsc4UrjgW7z4WtApzgBYkrjjskhl3gYkWnE6yWJE5ICrDHXLgUYO-0AGzBAc7qg6XibMR0r_JEUP5LVfGl7WyQCTm5mkF0v4IWKdbz7Ao2NSIM42ZaaFkj5iXJmRir4voVV15buKmDOb_Ti4CHFnHY Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:51:40.371915 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:51:40.373723 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47a4ab888dd74218ab5d7812ad095371", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:51:40.373723 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:40.373723 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:51:40.373723 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:40.373723 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:51:40.373723 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:51:40.373723 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:51:40.373723 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 4df05cbf303c4524a665b429f240a17a Jun 16 19:51:40.373723 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:51:40.373723 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:51:40.373723 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance b5581fbe-6950-4ade-86e0-a1fa41b436ca could not be found. Jun 16 19:51:40.373723 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': 'b5581fbe-6950-4ade-86e0-a1fa41b436ca'} Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5581fbe-6950-4ade-86e0-a1fa41b436ca could not be found. Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:51:40.374550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5581fbe-6950-4ade-86e0-a1fa41b436ca could not be found. Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5581fbe-6950-4ade-86e0-a1fa41b436ca could not be found. Jun 16 19:51:40.376055 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.377853 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c0471189-8232-40a1-aa5a-f36a36ade09b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Returning 404 to user: Instance b5581fbe-6950-4ade-86e0-a1fa41b436ca could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:51:40.377853 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c0471189-8232-40a1-aa5a-f36a36ade09b tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 404 len: 111 microversion: 2.1 time: 0.029758 Jun 16 19:51:40.377853 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 562/1105] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:51:40 2022] DELETE /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:51:40.381566 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4e7abc92-a8f8-4224-b1ca-8108865b0dc9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:40.382183 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4e7abc92-a8f8-4224-b1ca-8108865b0dc9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: b5581fbe-6950-4ade-86e0-a1fa41b436ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:40.388548 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4e7abc92-a8f8-4224-b1ca-8108865b0dc9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:40.388988 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4e7abc92-a8f8-4224-b1ca-8108865b0dc9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:40.389739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4e7abc92-a8f8-4224-b1ca-8108865b0dc9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:40.390173 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4e7abc92-a8f8-4224-b1ca-8108865b0dc9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:40.402910 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-4e7abc92-a8f8-4224-b1ca-8108865b0dc9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] HTTP exception thrown: Instance b5581fbe-6950-4ade-86e0-a1fa41b436ca could not be found. Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4e7abc92-a8f8-4224-b1ca-8108865b0dc9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Request method failure captured: Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca HTTP/1.1 Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4fyBPW6I9Gw6XK8Mc3wtez0zYsc4UrjgW7z4WtApzgBYkrjjskhl3gYkWnE6yWJE5ICrDHXLgUYO-0AGzBAc7qg6XibMR0r_JEUP5LVfGl7WyQCTm5mkF0v4IWKdbz7Ao2NSIM42ZaaFkj5iXJmRir4voVV15buKmDOb_Ti4CHFnHY Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:51:40.404361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:51:40.406518 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47a4ab888dd74218ab5d7812ad095371", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:51:40.406518 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:40.406518 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:51:40.406518 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:40.406518 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:51:40.406518 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:51:40.406518 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:51:40.406518 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 4df05cbf303c4524a665b429f240a17a Jun 16 19:51:40.406518 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:51:40.406518 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:51:40.406518 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance b5581fbe-6950-4ade-86e0-a1fa41b436ca could not be found. Jun 16 19:51:40.406518 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': 'b5581fbe-6950-4ade-86e0-a1fa41b436ca'} Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5581fbe-6950-4ade-86e0-a1fa41b436ca could not be found. Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:51:40.407478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:51:40.409070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:51:40.409070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:51:40.409070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:51:40.409070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:51:40.409070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:51:40.409070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:51:40.409070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:51:40.409070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5581fbe-6950-4ade-86e0-a1fa41b436ca could not be found. Jun 16 19:51:40.409070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.409070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:40.409070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.409070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:40.409070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:40.409070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:40.409070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:51:40.409070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:51:40.409070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5581fbe-6950-4ade-86e0-a1fa41b436ca could not be found. Jun 16 19:51:40.409070 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.410558 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4e7abc92-a8f8-4224-b1ca-8108865b0dc9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Returning 404 to user: Instance b5581fbe-6950-4ade-86e0-a1fa41b436ca could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:51:40.410558 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4e7abc92-a8f8-4224-b1ca-8108865b0dc9 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca" status: 404 len: 111 microversion: 2.1 time: 0.028503 Jun 16 19:51:40.410558 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 544/1106] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:40 2022] GET /compute/v2.1/servers/b5581fbe-6950-4ade-86e0-a1fa41b436ca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:51:40.414589 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b3714a95-867b-4ecb-928c-f3d3db298525 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:40.415109 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b3714a95-867b-4ecb-928c-f3d3db298525 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:40.421725 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b3714a95-867b-4ecb-928c-f3d3db298525 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:40.422165 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b3714a95-867b-4ecb-928c-f3d3db298525 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:40.422917 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b3714a95-867b-4ecb-928c-f3d3db298525 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:40.423373 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b3714a95-867b-4ecb-928c-f3d3db298525 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:40.436543 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-b3714a95-867b-4ecb-928c-f3d3db298525 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] HTTP exception thrown: Instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc could not be found. Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b3714a95-867b-4ecb-928c-f3d3db298525 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Request method failure captured: Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: DELETE /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc HTTP/1.1 Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4fyBPW6I9Gw6XK8Mc3wtez0zYsc4UrjgW7z4WtApzgBYkrjjskhl3gYkWnE6yWJE5ICrDHXLgUYO-0AGzBAc7qg6XibMR0r_JEUP5LVfGl7WyQCTm5mkF0v4IWKdbz7Ao2NSIM42ZaaFkj5iXJmRir4voVV15buKmDOb_Ti4CHFnHY Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:51:40.438104 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:51:40.439728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47a4ab888dd74218ab5d7812ad095371", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:51:40.439728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:40.439728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:51:40.439728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:40.439728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:51:40.439728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:51:40.439728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:51:40.439728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 4df05cbf303c4524a665b429f240a17a Jun 16 19:51:40.439728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:51:40.439728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:51:40.439728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc could not be found. Jun 16 19:51:40.439728 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': 'eb16dee5-a334-4d62-8b28-cd5a9632b6cc'} Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc could not be found. Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:51:40.441000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc could not be found. Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc could not be found. Jun 16 19:51:40.442546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.444129 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b3714a95-867b-4ecb-928c-f3d3db298525 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Returning 404 to user: Instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:51:40.444129 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b3714a95-867b-4ecb-928c-f3d3db298525 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "DELETE /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 404 len: 111 microversion: 2.1 time: 0.028819 Jun 16 19:51:40.444129 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 563/1107] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:51:40 2022] DELETE /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:51:40.447982 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-41303860-f1c1-449c-a2b9-d52b14857452 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:40.448592 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-41303860-f1c1-449c-a2b9-d52b14857452 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: eb16dee5-a334-4d62-8b28-cd5a9632b6cc] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:40.454539 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-41303860-f1c1-449c-a2b9-d52b14857452 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:40.455020 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-41303860-f1c1-449c-a2b9-d52b14857452 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:40.455767 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-41303860-f1c1-449c-a2b9-d52b14857452 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:40.456193 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-41303860-f1c1-449c-a2b9-d52b14857452 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:40.469557 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-41303860-f1c1-449c-a2b9-d52b14857452 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] HTTP exception thrown: Instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc could not be found. Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-41303860-f1c1-449c-a2b9-d52b14857452 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Request method failure captured: Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc HTTP/1.1 Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4fyBPW6I9Gw6XK8Mc3wtez0zYsc4UrjgW7z4WtApzgBYkrjjskhl3gYkWnE6yWJE5ICrDHXLgUYO-0AGzBAc7qg6XibMR0r_JEUP5LVfGl7WyQCTm5mkF0v4IWKdbz7Ao2NSIM42ZaaFkj5iXJmRir4voVV15buKmDOb_Ti4CHFnHY Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:51:40.471111 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:51:40.472745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47a4ab888dd74218ab5d7812ad095371", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:51:40.472745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:40.472745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:51:40.472745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:40.472745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:51:40.472745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:51:40.472745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:51:40.472745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 4df05cbf303c4524a665b429f240a17a Jun 16 19:51:40.472745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:51:40.472745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:51:40.472745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc could not be found. Jun 16 19:51:40.472745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': 'eb16dee5-a334-4d62-8b28-cd5a9632b6cc'} Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc could not be found. Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:51:40.473659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:51:40.475205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:51:40.475205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:51:40.475205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:51:40.475205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:51:40.475205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:51:40.475205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:51:40.475205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:51:40.475205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc could not be found. Jun 16 19:51:40.475205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.475205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:40.475205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.475205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:40.475205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:40.475205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:40.475205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:51:40.475205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:51:40.475205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc could not be found. Jun 16 19:51:40.475205 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:40.476654 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-41303860-f1c1-449c-a2b9-d52b14857452 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Returning 404 to user: Instance eb16dee5-a334-4d62-8b28-cd5a9632b6cc could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:51:40.476654 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-41303860-f1c1-449c-a2b9-d52b14857452 tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc" status: 404 len: 111 microversion: 2.1 time: 0.028364 Jun 16 19:51:40.476654 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 545/1108] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:40 2022] GET /compute/v2.1/servers/eb16dee5-a334-4d62-8b28-cd5a9632b6cc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:51:41.778540 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-13638e37-c031-43f2-8d3c-1e90102d275c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:41.779138 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-13638e37-c031-43f2-8d3c-1e90102d275c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:41.785887 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-13638e37-c031-43f2-8d3c-1e90102d275c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:41.786336 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-13638e37-c031-43f2-8d3c-1e90102d275c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:41.787136 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-13638e37-c031-43f2-8d3c-1e90102d275c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:41.787572 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-13638e37-c031-43f2-8d3c-1e90102d275c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:41.801798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-13638e37-c031-43f2-8d3c-1e90102d275c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] HTTP exception thrown: Instance 5c939c84-1712-4551-a3e3-cf42be4113fe could not be found. Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-13638e37-c031-43f2-8d3c-1e90102d275c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Request method failure captured: Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: DELETE /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe HTTP/1.1 Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4fyBPW6I9Gw6XK8Mc3wtez0zYsc4UrjgW7z4WtApzgBYkrjjskhl3gYkWnE6yWJE5ICrDHXLgUYO-0AGzBAc7qg6XibMR0r_JEUP5LVfGl7WyQCTm5mkF0v4IWKdbz7Ao2NSIM42ZaaFkj5iXJmRir4voVV15buKmDOb_Ti4CHFnHY Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:51:41.803431 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:51:41.805089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47a4ab888dd74218ab5d7812ad095371", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:51:41.805089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:41.805089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:51:41.805089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:41.805089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:51:41.805089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:51:41.805089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:51:41.805089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 4df05cbf303c4524a665b429f240a17a Jun 16 19:51:41.805089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:51:41.805089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:51:41.805089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance 5c939c84-1712-4551-a3e3-cf42be4113fe could not be found. Jun 16 19:51:41.805089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': '5c939c84-1712-4551-a3e3-cf42be4113fe'} Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c939c84-1712-4551-a3e3-cf42be4113fe could not be found. Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:51:41.805910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c939c84-1712-4551-a3e3-cf42be4113fe could not be found. Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c939c84-1712-4551-a3e3-cf42be4113fe could not be found. Jun 16 19:51:41.807287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:41.814609 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-13638e37-c031-43f2-8d3c-1e90102d275c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Returning 404 to user: Instance 5c939c84-1712-4551-a3e3-cf42be4113fe could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:51:41.814609 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-13638e37-c031-43f2-8d3c-1e90102d275c tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 404 len: 111 microversion: 2.1 time: 0.030099 Jun 16 19:51:41.814609 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 564/1109] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:51:41 2022] DELETE /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:51:41.820158 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1bc79b97-1886-420a-a124-50dcf9d1fe9d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:41.820772 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1bc79b97-1886-420a-a124-50dcf9d1fe9d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] [instance: 5c939c84-1712-4551-a3e3-cf42be4113fe] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:51:41.827138 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1bc79b97-1886-420a-a124-50dcf9d1fe9d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:41.827584 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1bc79b97-1886-420a-a124-50dcf9d1fe9d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:41.828377 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1bc79b97-1886-420a-a124-50dcf9d1fe9d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:51:41.828805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1bc79b97-1886-420a-a124-50dcf9d1fe9d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:51:41.842188 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-1bc79b97-1886-420a-a124-50dcf9d1fe9d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] HTTP exception thrown: Instance 5c939c84-1712-4551-a3e3-cf42be4113fe could not be found. Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1bc79b97-1886-420a-a124-50dcf9d1fe9d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Request method failure captured: Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe HTTP/1.1 Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4fyBPW6I9Gw6XK8Mc3wtez0zYsc4UrjgW7z4WtApzgBYkrjjskhl3gYkWnE6yWJE5ICrDHXLgUYO-0AGzBAc7qg6XibMR0r_JEUP5LVfGl7WyQCTm5mkF0v4IWKdbz7Ao2NSIM42ZaaFkj5iXJmRir4voVV15buKmDOb_Ti4CHFnHY Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:51:41.844182 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:51:41.845696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47a4ab888dd74218ab5d7812ad095371", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47a4ab888dd74218ab5d7812ad095371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:51:41.845696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:41.845696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 47a4ab888dd74218ab5d7812ad095371 Jun 16 19:51:41.845696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-113257992 Jun 16 19:51:41.845696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:51:41.845696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:51:41.845696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:51:41.845696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 4df05cbf303c4524a665b429f240a17a Jun 16 19:51:41.845696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeNegativeTest-113257992-project Jun 16 19:51:41.845696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:51:41.845696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance 5c939c84-1712-4551-a3e3-cf42be4113fe could not be found. Jun 16 19:51:41.845696 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': '5c939c84-1712-4551-a3e3-cf42be4113fe'} Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c939c84-1712-4551-a3e3-cf42be4113fe could not be found. Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:51:41.849956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:51:41.851700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:51:41.851700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:51:41.851700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:51:41.851700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:51:41.851700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:51:41.851700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:51:41.851700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:51:41.851700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c939c84-1712-4551-a3e3-cf42be4113fe could not be found. Jun 16 19:51:41.851700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:41.851700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:41.851700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:41.851700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:41.851700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:41.851700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:41.851700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:51:41.851700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:51:41.851700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c939c84-1712-4551-a3e3-cf42be4113fe could not be found. Jun 16 19:51:41.851700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:41.852885 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1bc79b97-1886-420a-a124-50dcf9d1fe9d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] Returning 404 to user: Instance 5c939c84-1712-4551-a3e3-cf42be4113fe could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:51:41.852885 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1bc79b97-1886-420a-a124-50dcf9d1fe9d tempest-AttachVolumeNegativeTest-113257992 tempest-AttachVolumeNegativeTest-113257992-project] 10.222.0.36 "GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe" status: 404 len: 111 microversion: 2.1 time: 0.029272 Jun 16 19:51:41.852885 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 546/1110] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:51:41 2022] GET /compute/v2.1/servers/5c939c84-1712-4551-a3e3-cf42be4113fe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:51:47.459798 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8edb57a9-b6b5-4d55-9408-5499ec4b3d60 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Action: 'create', calling method: .version_select at 0x7f050183b5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1803868605"}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:51:48.225174 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8edb57a9-b6b5-4d55-9408-5499ec4b3d60 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.881373 Jun 16 19:51:48.225803 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 565/1111] 10.222.0.36 () {60 vars in 1154 bytes} [Thu Jun 16 19:51:47 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 883 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 19:51:48.237204 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d89363b7-e9fe-47f4-9a73-b296a95b5b2a tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Calling method '.version_select at 0x7f0505d09040>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:48.284738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d89363b7-e9fe-47f4-9a73-b296a95b5b2a tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/80ce58c1-6819-4638-acac-de4ac055842f" status: 200 len: 345 microversion: 2.1 time: 0.051826 Jun 16 19:51:48.285323 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 547/1112] 10.222.0.36 () {58 vars in 1244 bytes} [Thu Jun 16 19:51:48 2022] GET /compute/v2.1/os-volumes/80ce58c1-6819-4638-acac-de4ac055842f => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:51:49.298427 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3fb4b003-bf3c-49ae-8a1f-1a22948ca6da tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Calling method '.version_select at 0x7f050161d310>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:49.344538 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-3fb4b003-bf3c-49ae-8a1f-1a22948ca6da tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/80ce58c1-6819-4638-acac-de4ac055842f" status: 200 len: 346 microversion: 2.1 time: 0.051063 Jun 16 19:51:49.345092 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 566/1113] 10.222.0.36 () {58 vars in 1244 bytes} [Thu Jun 16 19:51:49 2022] GET /compute/v2.1/os-volumes/80ce58c1-6819-4638-acac-de4ac055842f => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:51:49.356712 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-155288b2-0063-40da-8523-7b6e2691b144 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Action: 'create', calling method: .version_select at 0x7f0505c45d30>, body: {"snapshot": {"volume_id": "80ce58c1-6819-4638-acac-de4ac055842f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-728138684"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:51:50.089158 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-155288b2-0063-40da-8523-7b6e2691b144 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.736646 Jun 16 19:51:50.089743 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 548/1114] 10.222.0.36 () {60 vars in 1161 bytes} [Thu Jun 16 19:51:49 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:51:50.099925 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-58adce0b-d84a-4d7c-9094-21f10c5fbc82 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Calling method '.version_select at 0x7f05014a2160>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:50.128735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-58adce0b-d84a-4d7c-9094-21f10c5fbc82 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f054241f-cfc4-4c54-a064-99e8678eff6c" status: 200 len: 286 microversion: 2.1 time: 0.032791 Jun 16 19:51:50.129282 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 567/1115] 10.222.0.36 () {58 vars in 1250 bytes} [Thu Jun 16 19:51:50 2022] GET /compute/v2.1/os-snapshots/f054241f-cfc4-4c54-a064-99e8678eff6c => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:51:50.140209 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b19e76e6-5ce6-4aa3-bea0-6e27003860eb tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Calling method '.version_select at 0x7f0501524280>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:50.168554 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b19e76e6-5ce6-4aa3-bea0-6e27003860eb tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.032640 Jun 16 19:51:50.169108 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 549/1116] 10.222.0.36 () {58 vars in 1139 bytes} [Thu Jun 16 19:51:50 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:51:50.179022 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-cd3ff512-3d11-43d1-b2d2-249507a7d747 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Calling method '.version_select at 0x7f0501618790>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:50.208789 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-cd3ff512-3d11-43d1-b2d2-249507a7d747 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f054241f-cfc4-4c54-a064-99e8678eff6c" status: 200 len: 286 microversion: 2.1 time: 0.033562 Jun 16 19:51:50.209356 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 568/1117] 10.222.0.36 () {58 vars in 1250 bytes} [Thu Jun 16 19:51:50 2022] GET /compute/v2.1/os-snapshots/f054241f-cfc4-4c54-a064-99e8678eff6c => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:51:51.221662 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-49389e71-476b-4620-b249-6c079c88bbc5 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Calling method '.version_select at 0x7f0505cd6ee0>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:51.250398 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-49389e71-476b-4620-b249-6c079c88bbc5 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f054241f-cfc4-4c54-a064-99e8678eff6c" status: 200 len: 286 microversion: 2.1 time: 0.033503 Jun 16 19:51:51.250975 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 550/1118] 10.222.0.36 () {58 vars in 1250 bytes} [Thu Jun 16 19:51:51 2022] GET /compute/v2.1/os-snapshots/f054241f-cfc4-4c54-a064-99e8678eff6c => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:51:52.259253 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=11 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:51:52.260010 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:51:52.263884 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e257ec95-9687-440a-af42-6a3b74b1bd2b tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Calling method '.version_select at 0x7f050161db80>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:52.293719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e257ec95-9687-440a-af42-6a3b74b1bd2b tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f054241f-cfc4-4c54-a064-99e8678eff6c" status: 200 len: 286 microversion: 2.1 time: 0.035727 Jun 16 19:51:52.294297 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 569/1119] 10.222.0.36 () {58 vars in 1250 bytes} [Thu Jun 16 19:51:52 2022] GET /compute/v2.1/os-snapshots/f054241f-cfc4-4c54-a064-99e8678eff6c => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:51:53.302476 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:51:53.303267 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=52 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:51:53.307532 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-69124831-be8b-451b-a53a-7e6496955656 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Calling method '.version_select at 0x7f0505c640d0>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:53.338186 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-69124831-be8b-451b-a53a-7e6496955656 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f054241f-cfc4-4c54-a064-99e8678eff6c" status: 200 len: 286 microversion: 2.1 time: 0.036339 Jun 16 19:51:53.338743 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 551/1120] 10.222.0.36 () {58 vars in 1250 bytes} [Thu Jun 16 19:51:53 2022] GET /compute/v2.1/os-snapshots/f054241f-cfc4-4c54-a064-99e8678eff6c => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:51:54.350247 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0df8b9ee-1303-40ac-a553-b4b684bd01a1 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Calling method '.version_select at 0x7f0501785550>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:54.379983 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0df8b9ee-1303-40ac-a553-b4b684bd01a1 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f054241f-cfc4-4c54-a064-99e8678eff6c" status: 200 len: 287 microversion: 2.1 time: 0.034262 Jun 16 19:51:54.380542 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 570/1121] 10.222.0.36 () {58 vars in 1250 bytes} [Thu Jun 16 19:51:54 2022] GET /compute/v2.1/os-snapshots/f054241f-cfc4-4c54-a064-99e8678eff6c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:51:54.390983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0ea117d5-0cd9-4311-8d02-e470db54db9d tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Calling method '.version_select at 0x7f0505c54550>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:54.578130 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0ea117d5-0cd9-4311-8d02-e470db54db9d tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/f054241f-cfc4-4c54-a064-99e8678eff6c" status: 202 len: 0 microversion: 2.1 time: 0.191340 Jun 16 19:51:54.578721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 552/1122] 10.222.0.36 () {58 vars in 1253 bytes} [Thu Jun 16 19:51:54 2022] DELETE /compute/v2.1/os-snapshots/f054241f-cfc4-4c54-a064-99e8678eff6c => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:51:54.586738 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-2d75b15b-5497-41e3-becf-aebb097c8c7a tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Calling method '.version_select at 0x7f050161d3a0>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:54.617972 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-2d75b15b-5497-41e3-becf-aebb097c8c7a tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f054241f-cfc4-4c54-a064-99e8678eff6c" status: 200 len: 286 microversion: 2.1 time: 0.034997 Jun 16 19:51:54.618531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 571/1123] 10.222.0.36 () {58 vars in 1250 bytes} [Thu Jun 16 19:51:54 2022] GET /compute/v2.1/os-snapshots/f054241f-cfc4-4c54-a064-99e8678eff6c => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:51:55.631100 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d9f3b1ab-37ce-45b6-9236-c87ee6d31ab3 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Calling method '.version_select at 0x7f0505d09040>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:55.654993 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-d9f3b1ab-37ce-45b6-9236-c87ee6d31ab3 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] HTTP exception thrown: Snapshot f054241f-cfc4-4c54-a064-99e8678eff6c could not be found. Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d9f3b1ab-37ce-45b6-9236-c87ee6d31ab3 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Request method failure captured: Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/os-snapshots/f054241f-cfc4-4c54-a064-99e8678eff6c HTTP/1.1 Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4nTwhU_jtj19xBbmJsIjfP9P5rCaj0M4VrADYzMtdu2Vy6jvi7uxdtwFTNKsG1jbOW8In8W9YX22jjjHJDjO7CEXVYtvUBiOF93DLzbMj1qQIqiqI_WfknLZircGZPwxZIU2GUZxhzVWFR89m15FbYYr1eUfv7nx1MtB1eTYQ8Cfks Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 5dde443064694864b3c43f234e5a2fc0 Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-809640506 Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:51:55.663585 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:51:55.665274 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5dde443064694864b3c43f234e5a2fc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5dde443064694864b3c43f234e5a2fc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5dde443064694864b3c43f234e5a2fc0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5dde443064694864b3c43f234e5a2fc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:51:55.665274 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesSnapshotsTestJSON-809640506 Jun 16 19:51:55.665274 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 5dde443064694864b3c43f234e5a2fc0 Jun 16 19:51:55.665274 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-809640506 Jun 16 19:51:55.665274 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesSnapshotsTestJSON-809640506-project Jun 16 19:51:55.665274 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:51:55.665274 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:51:55.665274 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 2c5005a536c746fe8c86bc03426e6062 Jun 16 19:51:55.665274 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesSnapshotsTestJSON-809640506-project Jun 16 19:51:55.665274 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: Jun 16 19:51:55.665274 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Snapshot f054241f-cfc4-4c54-a064-99e8678eff6c could not be found. Jun 16 19:51:55.665274 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': 'f054241f-cfc4-4c54-a064-99e8678eff6c'} Jun 16 19:51:55.665274 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:51:55.666231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:55.666231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 19:51:55.666231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 19:51:55.666231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 19:51:55.666231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 19:51:55.666231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 19:51:55.666231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 19:51:55.666231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:51:55.666231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:51:55.666231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:51:55.666231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:51:55.666231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:51:55.666231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:51:55.666231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:51:55.666231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:51:55.666231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f054241f-cfc4-4c54-a064-99e8678eff6c could not be found. (HTTP 404) (Request-ID: req-56946cd2-8058-43d9-b8cb-ace93001c6bc) Jun 16 19:51:55.666231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:55.666231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:55.667721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:55.667721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:55.667721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 19:51:55.667721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 19:51:55.667721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 19:51:55.667721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 19:51:55.667721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 19:51:55.667721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 19:51:55.667721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 19:51:55.667721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 19:51:55.667721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 19:51:55.667721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 19:51:55.667721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 19:51:55.667721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 19:51:55.667721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 19:51:55.667721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 19:51:55.667721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:51:55.667721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:51:55.667721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f054241f-cfc4-4c54-a064-99e8678eff6c could not be found. Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 19:51:55.669608 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:51:55.671721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f054241f-cfc4-4c54-a064-99e8678eff6c could not be found. Jun 16 19:51:55.671721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:55.671721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:55.671721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:55.671721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:55.671721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:55.671721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:55.671721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:51:55.671721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:51:55.671721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f054241f-cfc4-4c54-a064-99e8678eff6c could not be found. Jun 16 19:51:55.671721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:55.671721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d9f3b1ab-37ce-45b6-9236-c87ee6d31ab3 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Returning 404 to user: Snapshot f054241f-cfc4-4c54-a064-99e8678eff6c could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:51:55.671721 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d9f3b1ab-37ce-45b6-9236-c87ee6d31ab3 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f054241f-cfc4-4c54-a064-99e8678eff6c" status: 404 len: 111 microversion: 2.1 time: 0.038232 Jun 16 19:51:55.672857 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 553/1124] 10.222.0.36 () {58 vars in 1250 bytes} [Thu Jun 16 19:51:55 2022] GET /compute/v2.1/os-snapshots/f054241f-cfc4-4c54-a064-99e8678eff6c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:51:55.674718 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-41c04538-0ed6-46d9-9661-d6814adcf9b1 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Calling method '.version_select at 0x7f05018845e0>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:55.973642 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-41c04538-0ed6-46d9-9661-d6814adcf9b1 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/80ce58c1-6819-4638-acac-de4ac055842f" status: 202 len: 0 microversion: 2.1 time: 0.303725 Jun 16 19:51:55.974207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 572/1125] 10.222.0.36 () {58 vars in 1247 bytes} [Thu Jun 16 19:51:55 2022] DELETE /compute/v2.1/os-volumes/80ce58c1-6819-4638-acac-de4ac055842f => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:51:55.983665 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4e5fee33-6726-48ee-ad15-93b30347dda6 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Calling method '.version_select at 0x7f0505ca2e50>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:56.030009 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4e5fee33-6726-48ee-ad15-93b30347dda6 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/80ce58c1-6819-4638-acac-de4ac055842f" status: 200 len: 345 microversion: 2.1 time: 0.050963 Jun 16 19:51:56.030563 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 554/1126] 10.222.0.36 () {58 vars in 1244 bytes} [Thu Jun 16 19:51:55 2022] GET /compute/v2.1/os-volumes/80ce58c1-6819-4638-acac-de4ac055842f => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:51:57.042061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-60d509b5-f90a-40c8-94a8-0287b09dc0d6 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Calling method '.version_select at 0x7f05012c5160>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:57.069119 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-60d509b5-f90a-40c8-94a8-0287b09dc0d6 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] HTTP exception thrown: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-60d509b5-f90a-40c8-94a8-0287b09dc0d6 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Request method failure captured: Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: GET /compute/v2.1/os-volumes/80ce58c1-6819-4638-acac-de4ac055842f HTTP/1.1 Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4nTwhU_jtj19xBbmJsIjfP9P5rCaj0M4VrADYzMtdu2Vy6jvi7uxdtwFTNKsG1jbOW8In8W9YX22jjjHJDjO7CEXVYtvUBiOF93DLzbMj1qQIqiqI_WfknLZircGZPwxZIU2GUZxhzVWFR89m15FbYYr1eUfv7nx1MtB1eTYQ8Cfks Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 5dde443064694864b3c43f234e5a2fc0 Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-809640506 Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:51:57.099361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:51:57.101004 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5dde443064694864b3c43f234e5a2fc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5dde443064694864b3c43f234e5a2fc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5dde443064694864b3c43f234e5a2fc0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5dde443064694864b3c43f234e5a2fc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:51:57.101004 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-VolumesSnapshotsTestJSON-809640506 Jun 16 19:51:57.101004 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 5dde443064694864b3c43f234e5a2fc0 Jun 16 19:51:57.101004 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-809640506 Jun 16 19:51:57.101004 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-VolumesSnapshotsTestJSON-809640506-project Jun 16 19:51:57.101004 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:51:57.101004 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:51:57.101004 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 2c5005a536c746fe8c86bc03426e6062 Jun 16 19:51:57.101004 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-VolumesSnapshotsTestJSON-809640506-project Jun 16 19:51:57.101004 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: Jun 16 19:51:57.101004 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. Jun 16 19:51:57.101004 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': '80ce58c1-6819-4638-acac-de4ac055842f'} Jun 16 19:51:57.101004 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:51:57.102240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:57.102240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:51:57.102240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:51:57.102240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 19:51:57.102240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 19:51:57.102240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 19:51:57.102240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 19:51:57.102240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:51:57.102240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:51:57.102240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:51:57.102240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:51:57.102240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:51:57.102240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:51:57.102240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:51:57.102240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:51:57.102240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. (HTTP 404) (Request-ID: req-d6dffd86-b298-4a3a-8fb9-b7b4764f4ed6) Jun 16 19:51:57.102240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.102240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:57.102240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.103709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:57.103709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 19:51:57.103709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 19:51:57.103709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 19:51:57.103709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 19:51:57.103709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 19:51:57.103709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 19:51:57.103709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 19:51:57.103709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 19:51:57.103709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:51:57.103709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:51:57.103709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 19:51:57.103709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 19:51:57.103709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 19:51:57.103709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 19:51:57.103709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:51:57.103709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:51:57.103709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:51:57.103709 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:51:57.105120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:51:57.105120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:51:57.105120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:51:57.105120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:51:57.105120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. Jun 16 19:51:57.105120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.105120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:57.105120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.105120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:57.105120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:57.105120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:57.105120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:51:57.105120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:51:57.105120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:51:57.105120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:51:57.105120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:51:57.105120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:51:57.105120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 19:51:57.105120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:51:57.106531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. Jun 16 19:51:57.106531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.106531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:57.106531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.106531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:57.106531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:57.106531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:57.106531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:51:57.106531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:51:57.106531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. Jun 16 19:51:57.106531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.106531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-60d509b5-f90a-40c8-94a8-0287b09dc0d6 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Returning 404 to user: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:51:57.106531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-60d509b5-f90a-40c8-94a8-0287b09dc0d6 tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/80ce58c1-6819-4638-acac-de4ac055842f" status: 404 len: 109 microversion: 2.1 time: 0.063032 Jun 16 19:51:57.106531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 573/1127] 10.222.0.36 () {58 vars in 1244 bytes} [Thu Jun 16 19:51:57 2022] GET /compute/v2.1/os-volumes/80ce58c1-6819-4638-acac-de4ac055842f => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:51:57.116161 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-47c7fa1b-b0e2-4180-b5bb-a9a5dd24349e tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Calling method '.version_select at 0x7f0505cd6940>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:57.143408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-47c7fa1b-b0e2-4180-b5bb-a9a5dd24349e tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] HTTP exception thrown: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-47c7fa1b-b0e2-4180-b5bb-a9a5dd24349e tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Request method failure captured: Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: DELETE /compute/v2.1/os-volumes/80ce58c1-6819-4638-acac-de4ac055842f HTTP/1.1 Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4nTwhU_jtj19xBbmJsIjfP9P5rCaj0M4VrADYzMtdu2Vy6jvi7uxdtwFTNKsG1jbOW8In8W9YX22jjjHJDjO7CEXVYtvUBiOF93DLzbMj1qQIqiqI_WfknLZircGZPwxZIU2GUZxhzVWFR89m15FbYYr1eUfv7nx1MtB1eTYQ8Cfks Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 5dde443064694864b3c43f234e5a2fc0 Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-809640506 Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:51:57.145350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:51:57.147076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5dde443064694864b3c43f234e5a2fc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5dde443064694864b3c43f234e5a2fc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5dde443064694864b3c43f234e5a2fc0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5dde443064694864b3c43f234e5a2fc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:51:57.147076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesSnapshotsTestJSON-809640506 Jun 16 19:51:57.147076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 5dde443064694864b3c43f234e5a2fc0 Jun 16 19:51:57.147076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-809640506 Jun 16 19:51:57.147076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesSnapshotsTestJSON-809640506-project Jun 16 19:51:57.147076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:51:57.147076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:51:57.147076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 2c5005a536c746fe8c86bc03426e6062 Jun 16 19:51:57.147076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesSnapshotsTestJSON-809640506-project Jun 16 19:51:57.147076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: Jun 16 19:51:57.147076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. Jun 16 19:51:57.147076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': '80ce58c1-6819-4638-acac-de4ac055842f'} Jun 16 19:51:57.147076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:51:57.148090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:57.148090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:51:57.148090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:51:57.148090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 19:51:57.148090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 19:51:57.148090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 19:51:57.148090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 19:51:57.148090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 19:51:57.148090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 19:51:57.148090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 19:51:57.148090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 19:51:57.148090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:51:57.148090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:51:57.148090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:51:57.148090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:51:57.148090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. (HTTP 404) (Request-ID: req-ae16398b-3cc9-4c3b-9170-2ad152f35b8e) Jun 16 19:51:57.148090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.148090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:57.148090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.149530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:57.149530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 19:51:57.149530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 19:51:57.149530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 19:51:57.149530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 19:51:57.149530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 19:51:57.149530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 19:51:57.149530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 19:51:57.149530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 19:51:57.149530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:51:57.149530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:51:57.149530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 19:51:57.149530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 19:51:57.149530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 19:51:57.149530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 19:51:57.149530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 19:51:57.149530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 19:51:57.149530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 19:51:57.149530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 19:51:57.151001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:51:57.151001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:51:57.151001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:51:57.151001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:51:57.151001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. Jun 16 19:51:57.151001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.151001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:57.151001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.151001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:57.151001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:57.151001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:57.151001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:51:57.151001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:51:57.151001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:51:57.151001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:51:57.151001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:51:57.151001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:51:57.151001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 19:51:57.151001 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:51:57.152439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. Jun 16 19:51:57.152439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.152439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:57.152439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.152439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:57.152439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:57.152439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:57.152439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:51:57.152439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:51:57.152439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. Jun 16 19:51:57.152439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.152439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-47c7fa1b-b0e2-4180-b5bb-a9a5dd24349e tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Returning 404 to user: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:51:57.152439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-47c7fa1b-b0e2-4180-b5bb-a9a5dd24349e tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/80ce58c1-6819-4638-acac-de4ac055842f" status: 404 len: 109 microversion: 2.1 time: 0.035139 Jun 16 19:51:57.152439 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 555/1128] 10.222.0.36 () {58 vars in 1247 bytes} [Thu Jun 16 19:51:57 2022] DELETE /compute/v2.1/os-volumes/80ce58c1-6819-4638-acac-de4ac055842f => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:51:57.154986 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5add7e14-40cf-4366-9246-e7c40b98015e tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Calling method '.version_select at 0x7f05015610d0>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:51:57.183244 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-5add7e14-40cf-4366-9246-e7c40b98015e tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] HTTP exception thrown: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5add7e14-40cf-4366-9246-e7c40b98015e tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Request method failure captured: Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: GET /compute/v2.1/os-volumes/80ce58c1-6819-4638-acac-de4ac055842f HTTP/1.1 Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4nTwhU_jtj19xBbmJsIjfP9P5rCaj0M4VrADYzMtdu2Vy6jvi7uxdtwFTNKsG1jbOW8In8W9YX22jjjHJDjO7CEXVYtvUBiOF93DLzbMj1qQIqiqI_WfknLZircGZPwxZIU2GUZxhzVWFR89m15FbYYr1eUfv7nx1MtB1eTYQ8Cfks Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 5dde443064694864b3c43f234e5a2fc0 Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-809640506 Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:51:57.185184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:51:57.187458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5dde443064694864b3c43f234e5a2fc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5dde443064694864b3c43f234e5a2fc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5dde443064694864b3c43f234e5a2fc0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5dde443064694864b3c43f234e5a2fc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:51:57.187458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-VolumesSnapshotsTestJSON-809640506 Jun 16 19:51:57.187458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 5dde443064694864b3c43f234e5a2fc0 Jun 16 19:51:57.187458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-809640506 Jun 16 19:51:57.187458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-VolumesSnapshotsTestJSON-809640506-project Jun 16 19:51:57.187458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:51:57.187458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:51:57.187458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 2c5005a536c746fe8c86bc03426e6062 Jun 16 19:51:57.187458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-VolumesSnapshotsTestJSON-809640506-project Jun 16 19:51:57.187458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: Jun 16 19:51:57.187458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. Jun 16 19:51:57.187458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': '80ce58c1-6819-4638-acac-de4ac055842f'} Jun 16 19:51:57.187458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:51:57.188448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:57.188448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:51:57.188448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:51:57.188448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 19:51:57.188448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 19:51:57.188448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 19:51:57.188448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 19:51:57.188448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:51:57.188448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:51:57.188448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:51:57.188448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:51:57.188448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:51:57.188448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:51:57.188448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:51:57.188448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:51:57.188448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. (HTTP 404) (Request-ID: req-fafab42a-f563-47b6-a105-ab0fdf9b19a5) Jun 16 19:51:57.188448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.188448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:57.188448 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.189890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:57.189890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 19:51:57.189890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 19:51:57.189890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 19:51:57.189890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 19:51:57.189890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 19:51:57.189890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 19:51:57.189890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 19:51:57.189890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 19:51:57.189890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:51:57.189890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:51:57.189890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 19:51:57.189890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 19:51:57.189890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 19:51:57.189890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 19:51:57.189890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:51:57.189890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:51:57.189890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:51:57.189890 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:51:57.191565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:51:57.191565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:51:57.191565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:51:57.191565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:51:57.191565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. Jun 16 19:51:57.191565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.191565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:57.191565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.191565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:57.191565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:57.191565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:57.191565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:51:57.191565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:51:57.191565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:51:57.191565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:51:57.191565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:51:57.191565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:51:57.191565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 19:51:57.191565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:51:57.193111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. Jun 16 19:51:57.193111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.193111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:51:57.193111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.193111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:51:57.193111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:51:57.193111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:51:57.193111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:51:57.193111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:51:57.193111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. Jun 16 19:51:57.193111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:51:57.193111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5add7e14-40cf-4366-9246-e7c40b98015e tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] Returning 404 to user: Volume 80ce58c1-6819-4638-acac-de4ac055842f could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:51:57.193111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5add7e14-40cf-4366-9246-e7c40b98015e tempest-VolumesSnapshotsTestJSON-809640506 tempest-VolumesSnapshotsTestJSON-809640506-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/80ce58c1-6819-4638-acac-de4ac055842f" status: 404 len: 109 microversion: 2.1 time: 0.036013 Jun 16 19:51:57.193111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 574/1129] 10.222.0.36 () {58 vars in 1244 bytes} [Thu Jun 16 19:51:57 2022] GET /compute/v2.1/os-volumes/80ce58c1-6819-4638-acac-de4ac055842f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:52:06.879407 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6fe9f50e-de4e-4cce-881a-058e042bdf31 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:06.881008 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6fe9f50e-de4e-4cce-881a-058e042bdf31 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:06.888206 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6fe9f50e-de4e-4cce-881a-058e042bdf31 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:06.888651 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6fe9f50e-de4e-4cce-881a-058e042bdf31 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:06.889409 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6fe9f50e-de4e-4cce-881a-058e042bdf31 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:06.889844 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6fe9f50e-de4e-4cce-881a-058e042bdf31 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:06.918736 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6fe9f50e-de4e-4cce-881a-058e042bdf31 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043237 Jun 16 19:52:06.919847 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 556/1130] 10.222.0.36 () {60 vars in 1342 bytes} [Thu Jun 16 19:52:06 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:06.983984 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b6572bd0-100d-4aae-a10b-743e0056122d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:06.984480 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b6572bd0-100d-4aae-a10b-743e0056122d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:06.991179 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b6572bd0-100d-4aae-a10b-743e0056122d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:06.991629 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b6572bd0-100d-4aae-a10b-743e0056122d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:06.992387 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b6572bd0-100d-4aae-a10b-743e0056122d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:06.992823 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b6572bd0-100d-4aae-a10b-743e0056122d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:07.017623 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b6572bd0-100d-4aae-a10b-743e0056122d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Going to try to terminate instance {{(pid=124551) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:52:07.453770 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b6572bd0-100d-4aae-a10b-743e0056122d tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "DELETE /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 204 len: 0 microversion: 2.20 time: 0.473901 Jun 16 19:52:07.454380 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 575/1131] 10.222.0.36 () {60 vars in 1279 bytes} [Thu Jun 16 19:52:06 2022] DELETE /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 19:52:07.462495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-50e23cb5-cdfb-428d-afcd-f8e7f56d5c3b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:07.463152 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-50e23cb5-cdfb-428d-afcd-f8e7f56d5c3b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:07.469783 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-50e23cb5-cdfb-428d-afcd-f8e7f56d5c3b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:07.470230 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-50e23cb5-cdfb-428d-afcd-f8e7f56d5c3b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:07.471016 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-50e23cb5-cdfb-428d-afcd-f8e7f56d5c3b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:07.471452 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-50e23cb5-cdfb-428d-afcd-f8e7f56d5c3b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:07.609025 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-50e23cb5-cdfb-428d-afcd-f8e7f56d5c3b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:07.617065 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-50e23cb5-cdfb-428d-afcd-f8e7f56d5c3b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:07.618560 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-50e23cb5-cdfb-428d-afcd-f8e7f56d5c3b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:07.619743 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-50e23cb5-cdfb-428d-afcd-f8e7f56d5c3b tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1723 microversion: 2.20 time: 0.161259 Jun 16 19:52:07.620297 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 557/1132] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:52:07 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:52:08.641296 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-280cca4e-cda4-4729-bc66-006b6373fcd5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:08.641917 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-280cca4e-cda4-4729-bc66-006b6373fcd5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:08.648682 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-280cca4e-cda4-4729-bc66-006b6373fcd5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:08.649214 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-280cca4e-cda4-4729-bc66-006b6373fcd5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:08.650181 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-280cca4e-cda4-4729-bc66-006b6373fcd5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:08.650628 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-280cca4e-cda4-4729-bc66-006b6373fcd5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:08.785015 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-280cca4e-cda4-4729-bc66-006b6373fcd5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:08.793196 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-280cca4e-cda4-4729-bc66-006b6373fcd5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:08.795297 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-280cca4e-cda4-4729-bc66-006b6373fcd5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:08.796466 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-280cca4e-cda4-4729-bc66-006b6373fcd5 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1723 microversion: 2.20 time: 0.162267 Jun 16 19:52:08.797020 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 576/1133] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:52:08 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:52:09.814040 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5a2ed959-aa10-40fa-a761-4e5e0f3ec842 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:09.814715 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5a2ed959-aa10-40fa-a761-4e5e0f3ec842 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:09.822495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5a2ed959-aa10-40fa-a761-4e5e0f3ec842 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:09.823057 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5a2ed959-aa10-40fa-a761-4e5e0f3ec842 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:09.823832 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5a2ed959-aa10-40fa-a761-4e5e0f3ec842 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:09.824436 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5a2ed959-aa10-40fa-a761-4e5e0f3ec842 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:09.889951 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5a2ed959-aa10-40fa-a761-4e5e0f3ec842 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:09.897896 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5a2ed959-aa10-40fa-a761-4e5e0f3ec842 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:09.899404 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5a2ed959-aa10-40fa-a761-4e5e0f3ec842 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:09.900611 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5a2ed959-aa10-40fa-a761-4e5e0f3ec842 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1656 microversion: 2.20 time: 0.090814 Jun 16 19:52:09.901155 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 558/1134] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:52:09 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1656 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:52:10.095270 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-9d37e73d-21c7-4bf7-9982-4d80c5f3b089 req-ae08cb2e-be9f-4c3f-b8f7-2136529e2201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "763636a9-34c8-47b8-8f39-fdbc2ff40e23", "name": "network-vif-deleted", "tag": "6a3e5e5b-38d9-46c6-86d4-f4326eeff1a1"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:52:10.108546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-9d37e73d-21c7-4bf7-9982-4d80c5f3b089 req-ae08cb2e-be9f-4c3f-b8f7-2136529e2201 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:10.108546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-9d37e73d-21c7-4bf7-9982-4d80c5f3b089 req-ae08cb2e-be9f-4c3f-b8f7-2136529e2201 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:10.117090 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-9d37e73d-21c7-4bf7-9982-4d80c5f3b089 req-ae08cb2e-be9f-4c3f-b8f7-2136529e2201 service nova] Creating event network-vif-deleted:6a3e5e5b-38d9-46c6-86d4-f4326eeff1a1 for instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 on hv-cinder-84617 Jun 16 19:52:10.121974 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-9d37e73d-21c7-4bf7-9982-4d80c5f3b089 req-ae08cb2e-be9f-4c3f-b8f7-2136529e2201 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030403 Jun 16 19:52:10.124282 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 577/1135] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:52:10.922081 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-af0c6115-fbb5-495e-8dad-f4580a2e6067 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:10.922705 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-af0c6115-fbb5-495e-8dad-f4580a2e6067 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:10.929332 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-af0c6115-fbb5-495e-8dad-f4580a2e6067 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:10.929780 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-af0c6115-fbb5-495e-8dad-f4580a2e6067 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:10.930727 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-af0c6115-fbb5-495e-8dad-f4580a2e6067 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:10.931201 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-af0c6115-fbb5-495e-8dad-f4580a2e6067 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:10.995691 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-af0c6115-fbb5-495e-8dad-f4580a2e6067 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:10.996139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-af0c6115-fbb5-495e-8dad-f4580a2e6067 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:10.996594 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-af0c6115-fbb5-495e-8dad-f4580a2e6067 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lazy-loading 'fault' on Instance uuid 763636a9-34c8-47b8-8f39-fdbc2ff40e23 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:52:11.040112 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-af0c6115-fbb5-495e-8dad-f4580a2e6067 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:11.048657 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-af0c6115-fbb5-495e-8dad-f4580a2e6067 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:11.050185 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-af0c6115-fbb5-495e-8dad-f4580a2e6067 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b5a188cee0d4727a14153088b8d95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38629fbda01748eb98e2dca20a3da10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:11.051347 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-af0c6115-fbb5-495e-8dad-f4580a2e6067 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 200 len: 1371 microversion: 2.20 time: 0.133937 Jun 16 19:52:11.051898 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 559/1136] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:52:10 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 1371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:52:12.070434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-acc111bd-ca2d-4627-8236-b26fcea1cad3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:12.071288 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-acc111bd-ca2d-4627-8236-b26fcea1cad3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:12.078489 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-acc111bd-ca2d-4627-8236-b26fcea1cad3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:12.079001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-acc111bd-ca2d-4627-8236-b26fcea1cad3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:12.079802 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-acc111bd-ca2d-4627-8236-b26fcea1cad3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:12.080241 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-acc111bd-ca2d-4627-8236-b26fcea1cad3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:12.094510 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-acc111bd-ca2d-4627-8236-b26fcea1cad3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] HTTP exception thrown: Instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 could not be found. Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-acc111bd-ca2d-4627-8236-b26fcea1cad3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Request method failure captured: Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 HTTP/1.1 Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4fuF48kNvkcNQeEjE8tJoECAJsaDQhoGQWc5qC1SqIAqTJKM2Jw7679gQ2F00Fu5MKD94wZ3LDhOFV7qm6yEwPJNKsXffaIRbj8c74SxV-T540QYq8P1gqh-8-MhAgGulq_TmPG_4JZIAJIzrtj1FOqhUbJhpU5rbp9oQ8q-PFoTAI Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 38629fbda01748eb98e2dca20a3da10a Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-906332430 Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:52:12.095424 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:52:12.097152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38629fbda01748eb98e2dca20a3da10a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/38629fbda01748eb98e2dca20a3da10a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_38629fbda01748eb98e2dca20a3da10a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38629fbda01748eb98e2dca20a3da10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:52:12.097152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-AttachVolumeShelveTestJSON-906332430 Jun 16 19:52:12.097152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 38629fbda01748eb98e2dca20a3da10a Jun 16 19:52:12.097152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-906332430 Jun 16 19:52:12.097152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-AttachVolumeShelveTestJSON-906332430-project Jun 16 19:52:12.097152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:52:12.097152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:52:12.097152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 8b5a188cee0d4727a14153088b8d95c6 Jun 16 19:52:12.097152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-AttachVolumeShelveTestJSON-906332430-project Jun 16 19:52:12.097152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:52:12.097152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 could not be found. Jun 16 19:52:12.097152 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': '763636a9-34c8-47b8-8f39-fdbc2ff40e23'} Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 could not be found. Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:52:12.098054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:52:12.099708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:52:12.099708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:52:12.099708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:52:12.099708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:52:12.099708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:52:12.099708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:52:12.099708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:52:12.099708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 could not be found. Jun 16 19:52:12.099708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:52:12.099708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:52:12.099708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:52:12.099708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:52:12.099708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:52:12.099708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:52:12.099708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:52:12.099708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:52:12.099708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 could not be found. Jun 16 19:52:12.099708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:52:12.101157 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-acc111bd-ca2d-4627-8236-b26fcea1cad3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Returning 404 to user: Instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:52:12.101157 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-acc111bd-ca2d-4627-8236-b26fcea1cad3 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 404 len: 111 microversion: 2.20 time: 0.030761 Jun 16 19:52:12.101157 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 578/1137] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:52:12 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:52:12.106040 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0adf67b1-a64a-459a-b2ed-29c0d3465c98 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '.version_select at 0x7f0505c91c10>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:12.235812 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0adf67b1-a64a-459a-b2ed-29c0d3465c98 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1609834858" status: 204 len: 0 microversion: 2.20 time: 0.133411 Jun 16 19:52:12.236388 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 560/1138] 10.222.0.36 () {60 vars in 1261 bytes} [Thu Jun 16 19:52:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1609834858 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 19:52:14.374040 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0a1a93f2-a0f9-47d6-8fd3-04838961222c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:14.377733 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0a1a93f2-a0f9-47d6-8fd3-04838961222c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:14.381033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0a1a93f2-a0f9-47d6-8fd3-04838961222c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:14.381471 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0a1a93f2-a0f9-47d6-8fd3-04838961222c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:14.382218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0a1a93f2-a0f9-47d6-8fd3-04838961222c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:14.382645 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0a1a93f2-a0f9-47d6-8fd3-04838961222c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:14.395580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-0a1a93f2-a0f9-47d6-8fd3-04838961222c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] HTTP exception thrown: Instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 could not be found. Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0a1a93f2-a0f9-47d6-8fd3-04838961222c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Request method failure captured: Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: DELETE /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 HTTP/1.1 Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4fuF48kNvkcNQeEjE8tJoECAJsaDQhoGQWc5qC1SqIAqTJKM2Jw7679gQ2F00Fu5MKD94wZ3LDhOFV7qm6yEwPJNKsXffaIRbj8c74SxV-T540QYq8P1gqh-8-MhAgGulq_TmPG_4JZIAJIzrtj1FOqhUbJhpU5rbp9oQ8q-PFoTAI Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 38629fbda01748eb98e2dca20a3da10a Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-906332430 Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:52:14.397105 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:52:14.398847 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38629fbda01748eb98e2dca20a3da10a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/38629fbda01748eb98e2dca20a3da10a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_38629fbda01748eb98e2dca20a3da10a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38629fbda01748eb98e2dca20a3da10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:52:14.398847 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-AttachVolumeShelveTestJSON-906332430 Jun 16 19:52:14.398847 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 38629fbda01748eb98e2dca20a3da10a Jun 16 19:52:14.398847 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-906332430 Jun 16 19:52:14.398847 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-AttachVolumeShelveTestJSON-906332430-project Jun 16 19:52:14.398847 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:52:14.398847 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:52:14.398847 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 8b5a188cee0d4727a14153088b8d95c6 Jun 16 19:52:14.398847 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-AttachVolumeShelveTestJSON-906332430-project Jun 16 19:52:14.398847 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:52:14.398847 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 could not be found. Jun 16 19:52:14.398847 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': '763636a9-34c8-47b8-8f39-fdbc2ff40e23'} Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 could not be found. Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:52:14.399813 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 could not be found. Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 could not be found. Jun 16 19:52:14.401403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:52:14.403184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0a1a93f2-a0f9-47d6-8fd3-04838961222c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Returning 404 to user: Instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:52:14.403184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0a1a93f2-a0f9-47d6-8fd3-04838961222c tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "DELETE /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 404 len: 111 microversion: 2.20 time: 0.028857 Jun 16 19:52:14.403184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 579/1139] 10.222.0.36 () {60 vars in 1279 bytes} [Thu Jun 16 19:52:14 2022] DELETE /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:52:14.407377 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1e055143-1bb4-4201-88b9-153954e97896 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:14.408018 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1e055143-1bb4-4201-88b9-153954e97896 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: 763636a9-34c8-47b8-8f39-fdbc2ff40e23] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:14.414821 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1e055143-1bb4-4201-88b9-153954e97896 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:14.415277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1e055143-1bb4-4201-88b9-153954e97896 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:14.416036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1e055143-1bb4-4201-88b9-153954e97896 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:14.416464 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1e055143-1bb4-4201-88b9-153954e97896 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:14.429733 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-1e055143-1bb4-4201-88b9-153954e97896 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] HTTP exception thrown: Instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 could not be found. Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1e055143-1bb4-4201-88b9-153954e97896 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Request method failure captured: Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 HTTP/1.1 Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4fuF48kNvkcNQeEjE8tJoECAJsaDQhoGQWc5qC1SqIAqTJKM2Jw7679gQ2F00Fu5MKD94wZ3LDhOFV7qm6yEwPJNKsXffaIRbj8c74SxV-T540QYq8P1gqh-8-MhAgGulq_TmPG_4JZIAJIzrtj1FOqhUbJhpU5rbp9oQ8q-PFoTAI Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 38629fbda01748eb98e2dca20a3da10a Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-906332430 Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:52:14.431272 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:52:14.433102 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38629fbda01748eb98e2dca20a3da10a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/38629fbda01748eb98e2dca20a3da10a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_38629fbda01748eb98e2dca20a3da10a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38629fbda01748eb98e2dca20a3da10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:52:14.433102 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeShelveTestJSON-906332430 Jun 16 19:52:14.433102 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 38629fbda01748eb98e2dca20a3da10a Jun 16 19:52:14.433102 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-906332430 Jun 16 19:52:14.433102 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeShelveTestJSON-906332430-project Jun 16 19:52:14.433102 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:52:14.433102 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:52:14.433102 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 8b5a188cee0d4727a14153088b8d95c6 Jun 16 19:52:14.433102 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeShelveTestJSON-906332430-project Jun 16 19:52:14.433102 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:52:14.433102 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 could not be found. Jun 16 19:52:14.433102 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': '763636a9-34c8-47b8-8f39-fdbc2ff40e23'} Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 could not be found. Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:52:14.434075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:52:14.436340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:52:14.436340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:52:14.436340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:52:14.436340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:52:14.436340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:52:14.436340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:52:14.436340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:52:14.436340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 could not be found. Jun 16 19:52:14.436340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:52:14.436340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:52:14.436340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:52:14.436340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:52:14.436340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:52:14.436340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:52:14.436340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:52:14.436340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:52:14.436340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 could not be found. Jun 16 19:52:14.436340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:52:14.437730 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1e055143-1bb4-4201-88b9-153954e97896 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Returning 404 to user: Instance 763636a9-34c8-47b8-8f39-fdbc2ff40e23 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:52:14.437730 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1e055143-1bb4-4201-88b9-153954e97896 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23" status: 404 len: 111 microversion: 2.20 time: 0.029607 Jun 16 19:52:14.437730 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 561/1140] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:52:14 2022] GET /compute/v2.1/servers/763636a9-34c8-47b8-8f39-fdbc2ff40e23 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:52:15.998865 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-eef1dbc9-198b-4382-bfb1-411217f33a93 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:15.999390 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-eef1dbc9-198b-4382-bfb1-411217f33a93 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:16.006082 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eef1dbc9-198b-4382-bfb1-411217f33a93 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:16.006534 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eef1dbc9-198b-4382-bfb1-411217f33a93 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:16.007370 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eef1dbc9-198b-4382-bfb1-411217f33a93 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:16.007804 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eef1dbc9-198b-4382-bfb1-411217f33a93 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:16.020965 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-eef1dbc9-198b-4382-bfb1-411217f33a93 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] HTTP exception thrown: Instance f667dde1-232e-4f14-917f-0a749279d6a8 could not be found. Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-eef1dbc9-198b-4382-bfb1-411217f33a93 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Request method failure captured: Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: DELETE /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 HTTP/1.1 Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4fuF48kNvkcNQeEjE8tJoECAJsaDQhoGQWc5qC1SqIAqTJKM2Jw7679gQ2F00Fu5MKD94wZ3LDhOFV7qm6yEwPJNKsXffaIRbj8c74SxV-T540QYq8P1gqh-8-MhAgGulq_TmPG_4JZIAJIzrtj1FOqhUbJhpU5rbp9oQ8q-PFoTAI Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 38629fbda01748eb98e2dca20a3da10a Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-906332430 Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:52:16.022581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:52:16.024290 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38629fbda01748eb98e2dca20a3da10a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/38629fbda01748eb98e2dca20a3da10a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_38629fbda01748eb98e2dca20a3da10a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38629fbda01748eb98e2dca20a3da10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:52:16.024290 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-AttachVolumeShelveTestJSON-906332430 Jun 16 19:52:16.024290 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 38629fbda01748eb98e2dca20a3da10a Jun 16 19:52:16.024290 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-906332430 Jun 16 19:52:16.024290 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-AttachVolumeShelveTestJSON-906332430-project Jun 16 19:52:16.024290 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:52:16.024290 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:52:16.024290 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 8b5a188cee0d4727a14153088b8d95c6 Jun 16 19:52:16.024290 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-AttachVolumeShelveTestJSON-906332430-project Jun 16 19:52:16.024290 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:52:16.024290 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance f667dde1-232e-4f14-917f-0a749279d6a8 could not be found. Jun 16 19:52:16.024290 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': 'f667dde1-232e-4f14-917f-0a749279d6a8'} Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f667dde1-232e-4f14-917f-0a749279d6a8 could not be found. Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:52:16.025184 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f667dde1-232e-4f14-917f-0a749279d6a8 could not be found. Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f667dde1-232e-4f14-917f-0a749279d6a8 could not be found. Jun 16 19:52:16.026764 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:52:16.028289 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-eef1dbc9-198b-4382-bfb1-411217f33a93 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Returning 404 to user: Instance f667dde1-232e-4f14-917f-0a749279d6a8 could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:52:16.028289 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-eef1dbc9-198b-4382-bfb1-411217f33a93 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 404 len: 111 microversion: 2.20 time: 0.029547 Jun 16 19:52:16.028289 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 580/1141] 10.222.0.36 () {60 vars in 1279 bytes} [Thu Jun 16 19:52:15 2022] DELETE /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:52:16.032499 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d198e35e-e6e9-4988-9334-16ae0263c1e2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:16.033159 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d198e35e-e6e9-4988-9334-16ae0263c1e2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] [instance: f667dde1-232e-4f14-917f-0a749279d6a8] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:16.039725 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d198e35e-e6e9-4988-9334-16ae0263c1e2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:16.040169 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d198e35e-e6e9-4988-9334-16ae0263c1e2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:16.043247 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d198e35e-e6e9-4988-9334-16ae0263c1e2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:16.043247 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d198e35e-e6e9-4988-9334-16ae0263c1e2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:16.054780 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-d198e35e-e6e9-4988-9334-16ae0263c1e2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] HTTP exception thrown: Instance f667dde1-232e-4f14-917f-0a749279d6a8 could not be found. Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d198e35e-e6e9-4988-9334-16ae0263c1e2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Request method failure captured: Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 HTTP/1.1 Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4fuF48kNvkcNQeEjE8tJoECAJsaDQhoGQWc5qC1SqIAqTJKM2Jw7679gQ2F00Fu5MKD94wZ3LDhOFV7qm6yEwPJNKsXffaIRbj8c74SxV-T540QYq8P1gqh-8-MhAgGulq_TmPG_4JZIAJIzrtj1FOqhUbJhpU5rbp9oQ8q-PFoTAI Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 38629fbda01748eb98e2dca20a3da10a Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-906332430 Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:52:16.056408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:52:16.058067 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38629fbda01748eb98e2dca20a3da10a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/38629fbda01748eb98e2dca20a3da10a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_38629fbda01748eb98e2dca20a3da10a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38629fbda01748eb98e2dca20a3da10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:52:16.058067 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeShelveTestJSON-906332430 Jun 16 19:52:16.058067 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 38629fbda01748eb98e2dca20a3da10a Jun 16 19:52:16.058067 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-906332430 Jun 16 19:52:16.058067 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeShelveTestJSON-906332430-project Jun 16 19:52:16.058067 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:52:16.058067 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:52:16.058067 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 8b5a188cee0d4727a14153088b8d95c6 Jun 16 19:52:16.058067 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeShelveTestJSON-906332430-project Jun 16 19:52:16.058067 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:52:16.058067 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance f667dde1-232e-4f14-917f-0a749279d6a8 could not be found. Jun 16 19:52:16.058067 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': 'f667dde1-232e-4f14-917f-0a749279d6a8'} Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f667dde1-232e-4f14-917f-0a749279d6a8 could not be found. Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:52:16.058913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:52:16.060766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:52:16.060766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:52:16.060766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:52:16.060766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:52:16.060766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:52:16.060766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:52:16.060766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:52:16.060766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f667dde1-232e-4f14-917f-0a749279d6a8 could not be found. Jun 16 19:52:16.060766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:52:16.060766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:52:16.060766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:52:16.060766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:52:16.060766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:52:16.060766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:52:16.060766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:52:16.060766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:52:16.060766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f667dde1-232e-4f14-917f-0a749279d6a8 could not be found. Jun 16 19:52:16.060766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:52:16.061903 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d198e35e-e6e9-4988-9334-16ae0263c1e2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] Returning 404 to user: Instance f667dde1-232e-4f14-917f-0a749279d6a8 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:52:16.061903 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d198e35e-e6e9-4988-9334-16ae0263c1e2 tempest-AttachVolumeShelveTestJSON-906332430 tempest-AttachVolumeShelveTestJSON-906332430-project] 10.222.0.36 "GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8" status: 404 len: 111 microversion: 2.20 time: 0.029178 Jun 16 19:52:16.061903 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 562/1142] 10.222.0.36 () {60 vars in 1276 bytes} [Thu Jun 16 19:52:16 2022] GET /compute/v2.1/servers/f667dde1-232e-4f14-917f-0a749279d6a8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:52:28.044683 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:52:28.045415 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:52:28.201587 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a985bd5b-134c-47f8-9ac3-581d58d56aba tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Action: 'create', calling method: .version_select at 0x7f0501513d30>, body: {"keypair": {"name": "tempest-keypair-956652141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDnDgcmcz+qw7w1lYNicvJsd/b3k2uwuVQBb5LtjNe1yQxycakLeDNJGJH0IFwD5mOLJUuGXU0oAu71Oco++YE6aNV6+aRW9WcX70/5WgBo9MLtY84zm0A9kqb3UtcETA=="}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:52:28.216615 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-a985bd5b-134c-47f8-9ac3-581d58d56aba tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Getting quotas for project 7caa2a2f7c644b16a76b9dff92a2b2e8. Resources: {'key_pairs'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:52:28.220556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-a985bd5b-134c-47f8-9ac3-581d58d56aba tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Getting quotas for user 0251939fa06a45da898a12a37ac91163 and project 7caa2a2f7c644b16a76b9dff92a2b2e8. Resources: {'key_pairs'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:52:28.294511 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a985bd5b-134c-47f8-9ac3-581d58d56aba tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.254673 Jun 16 19:52:28.295153 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 581/1143] 10.222.0.36 () {60 vars in 1158 bytes} [Thu Jun 16 19:52:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:52:31.078228 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-32dd8e62-59cf-4ca1-9bba-bfac07baae35 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1266493764", "imageRef": "9fcb2be6-02db-4853-a8d6-6478a75f26a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7117fea0-e71e-4ef8-a249-78145283a66c"}], "security_groups": [{"name": "tempest-securitygroup--194715440"}], "key_name": "tempest-keypair-956652141", "user_data": "}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:52:31.090529 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:52:31.090529 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=30 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:52:31.225397 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-32dd8e62-59cf-4ca1-9bba-bfac07baae35 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] validate_networks() for [('7117fea0-e71e-4ef8-a249-78145283a66c', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:52:31.709375 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-32dd8e62-59cf-4ca1-9bba-bfac07baae35 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:52:31.709805 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-32dd8e62-59cf-4ca1-9bba-bfac07baae35 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:52:31.710286 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-32dd8e62-59cf-4ca1-9bba-bfac07baae35 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:52:31.710701 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-32dd8e62-59cf-4ca1-9bba-bfac07baae35 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:52:31.711176 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-32dd8e62-59cf-4ca1-9bba-bfac07baae35 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:52:31.719883 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-32dd8e62-59cf-4ca1-9bba-bfac07baae35 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:31.720333 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-32dd8e62-59cf-4ca1-9bba-bfac07baae35 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:31.721131 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-32dd8e62-59cf-4ca1-9bba-bfac07baae35 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:31.721593 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-32dd8e62-59cf-4ca1-9bba-bfac07baae35 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:31.739035 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-32dd8e62-59cf-4ca1-9bba-bfac07baae35 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Getting quotas for project 7caa2a2f7c644b16a76b9dff92a2b2e8. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:52:31.742976 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-32dd8e62-59cf-4ca1-9bba-bfac07baae35 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Getting quotas for user 0251939fa06a45da898a12a37ac91163 and project 7caa2a2f7c644b16a76b9dff92a2b2e8. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:52:31.754282 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-32dd8e62-59cf-4ca1-9bba-bfac07baae35 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:52:31.756581 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-32dd8e62-59cf-4ca1-9bba-bfac07baae35 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcb2be6-02db-4853-a8d6-6478a75f26a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:52:31.934593 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-32dd8e62-59cf-4ca1-9bba-bfac07baae35 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.861176 Jun 16 19:52:31.935209 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 563/1144] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:52:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:52:31.946556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-ef9a9d04-7980-4223-9cbf-d72d85093048 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:31.947192 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-ef9a9d04-7980-4223-9cbf-d72d85093048 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:32.001626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ef9a9d04-7980-4223-9cbf-d72d85093048 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:32.010066 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-ef9a9d04-7980-4223-9cbf-d72d85093048 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1237 microversion: 2.1 time: 0.068542 Jun 16 19:52:32.010633 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 582/1145] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:31 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:33.026503 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f30e06a4-ebcd-4c08-93e8-b34e4961f0e2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:33.027186 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f30e06a4-ebcd-4c08-93e8-b34e4961f0e2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:33.033764 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f30e06a4-ebcd-4c08-93e8-b34e4961f0e2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:33.034207 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f30e06a4-ebcd-4c08-93e8-b34e4961f0e2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:33.034987 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f30e06a4-ebcd-4c08-93e8-b34e4961f0e2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:33.035418 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f30e06a4-ebcd-4c08-93e8-b34e4961f0e2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:33.095490 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f30e06a4-ebcd-4c08-93e8-b34e4961f0e2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:33.103405 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f30e06a4-ebcd-4c08-93e8-b34e4961f0e2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1241 microversion: 2.1 time: 0.081192 Jun 16 19:52:33.103961 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 564/1146] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:33 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:34.120706 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-eea25bd1-70a9-4c18-802c-65fccc16c266 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:34.121866 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-eea25bd1-70a9-4c18-802c-65fccc16c266 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:34.128302 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eea25bd1-70a9-4c18-802c-65fccc16c266 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:34.128749 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eea25bd1-70a9-4c18-802c-65fccc16c266 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:34.129543 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eea25bd1-70a9-4c18-802c-65fccc16c266 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:34.129972 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-eea25bd1-70a9-4c18-802c-65fccc16c266 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:34.191666 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-eea25bd1-70a9-4c18-802c-65fccc16c266 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:34.199133 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-eea25bd1-70a9-4c18-802c-65fccc16c266 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1289 microversion: 2.1 time: 0.082181 Jun 16 19:52:34.199688 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 583/1147] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:34 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1289 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:35.217147 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-374b1909-7fbb-4382-b0e0-8332965159ca tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:35.218027 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-374b1909-7fbb-4382-b0e0-8332965159ca tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:35.225829 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-374b1909-7fbb-4382-b0e0-8332965159ca tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:35.226280 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-374b1909-7fbb-4382-b0e0-8332965159ca tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:35.227100 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-374b1909-7fbb-4382-b0e0-8332965159ca tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:35.227541 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-374b1909-7fbb-4382-b0e0-8332965159ca tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:35.302190 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-374b1909-7fbb-4382-b0e0-8332965159ca tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:35.309948 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-374b1909-7fbb-4382-b0e0-8332965159ca tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1295 microversion: 2.1 time: 0.097335 Jun 16 19:52:35.310513 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 565/1148] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:35 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1295 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:36.330025 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8d64f17b-6401-4558-b561-193592beed95 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:36.330646 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8d64f17b-6401-4558-b561-193592beed95 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:36.337084 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8d64f17b-6401-4558-b561-193592beed95 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:36.337522 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8d64f17b-6401-4558-b561-193592beed95 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:36.338283 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8d64f17b-6401-4558-b561-193592beed95 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:36.338726 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8d64f17b-6401-4558-b561-193592beed95 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:36.434152 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-2b61c985-41f5-41c8-b6c6-a3bb2838869d req-06999249-efc8-4fae-aa66-5e3ee0ad451c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e88f61-79c7-4911-a9e4-a0abdf11a512", "tag": "c79a35a0-41f6-4a23-a473-df78af5343e6"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:52:36.447814 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-2b61c985-41f5-41c8-b6c6-a3bb2838869d req-06999249-efc8-4fae-aa66-5e3ee0ad451c service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:36.448589 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-2b61c985-41f5-41c8-b6c6-a3bb2838869d req-06999249-efc8-4fae-aa66-5e3ee0ad451c service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:36.554450 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8d64f17b-6401-4558-b561-193592beed95 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:36.563666 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8d64f17b-6401-4558-b561-193592beed95 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1362 microversion: 2.1 time: 0.237303 Jun 16 19:52:36.564938 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 584/1149] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:36 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:36.636637 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-2b61c985-41f5-41c8-b6c6-a3bb2838869d req-06999249-efc8-4fae-aa66-5e3ee0ad451c service nova] Creating event network-changed:c79a35a0-41f6-4a23-a473-df78af5343e6 for instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 on hv-cinder-84617 Jun 16 19:52:36.644572 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-2b61c985-41f5-41c8-b6c6-a3bb2838869d req-06999249-efc8-4fae-aa66-5e3ee0ad451c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214940 Jun 16 19:52:36.645368 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 566/1150] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:52:37.581208 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-2c2028ce-7cb8-472b-afb7-6e65bd8e0d9c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:37.581817 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-2c2028ce-7cb8-472b-afb7-6e65bd8e0d9c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:37.588209 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2c2028ce-7cb8-472b-afb7-6e65bd8e0d9c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:37.588649 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2c2028ce-7cb8-472b-afb7-6e65bd8e0d9c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:37.589402 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2c2028ce-7cb8-472b-afb7-6e65bd8e0d9c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:37.590426 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2c2028ce-7cb8-472b-afb7-6e65bd8e0d9c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:37.719938 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-2c2028ce-7cb8-472b-afb7-6e65bd8e0d9c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:37.727380 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-2c2028ce-7cb8-472b-afb7-6e65bd8e0d9c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1362 microversion: 2.1 time: 0.149859 Jun 16 19:52:37.727940 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 585/1151] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:37 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:37.931914 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8a746cb3-80f6-45c3-a675-2e2a700252c7 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:52:37.932569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8a746cb3-80f6-45c3-a675-2e2a700252c7 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:37.939222 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8a746cb3-80f6-45c3-a675-2e2a700252c7 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:37.939920 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8a746cb3-80f6-45c3-a675-2e2a700252c7 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:37.940668 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8a746cb3-80f6-45c3-a675-2e2a700252c7 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:37.941095 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8a746cb3-80f6-45c3-a675-2e2a700252c7 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:37.963699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-8a746cb3-80f6-45c3-a675-2e2a700252c7 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lazy-loading 'flavor' on Instance uuid 5b0caba3-ed91-4ea7-a868-4f38cc779fc1 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:52:38.425091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8a746cb3-80f6-45c3-a675-2e2a700252c7 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "POST /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1/action" status: 202 len: 0 microversion: 2.1 time: 0.497732 Jun 16 19:52:38.430260 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 567/1152] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Jun 16 19:52:37 2022] POST /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:52:38.437715 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a3646d25-8fda-49a9-b3eb-d74f2aa982b3 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:38.438367 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a3646d25-8fda-49a9-b3eb-d74f2aa982b3 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:38.444719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a3646d25-8fda-49a9-b3eb-d74f2aa982b3 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:38.445505 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a3646d25-8fda-49a9-b3eb-d74f2aa982b3 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:38.446423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a3646d25-8fda-49a9-b3eb-d74f2aa982b3 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:38.446998 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a3646d25-8fda-49a9-b3eb-d74f2aa982b3 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:38.634721 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a3646d25-8fda-49a9-b3eb-d74f2aa982b3 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:38.645280 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a3646d25-8fda-49a9-b3eb-d74f2aa982b3 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1567 microversion: 2.1 time: 0.214293 Jun 16 19:52:38.645852 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 586/1153] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:38 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:52:38.745199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-45c779a3-ca49-4b2d-95af-1a8de269edbd tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:38.750108 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-45c779a3-ca49-4b2d-95af-1a8de269edbd tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:38.752628 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-45c779a3-ca49-4b2d-95af-1a8de269edbd tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:38.753086 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-45c779a3-ca49-4b2d-95af-1a8de269edbd tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:38.753855 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-45c779a3-ca49-4b2d-95af-1a8de269edbd tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:38.754297 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-45c779a3-ca49-4b2d-95af-1a8de269edbd tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:38.885556 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-45c779a3-ca49-4b2d-95af-1a8de269edbd tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:38.893598 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-45c779a3-ca49-4b2d-95af-1a8de269edbd tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1362 microversion: 2.1 time: 0.152653 Jun 16 19:52:38.894156 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 568/1154] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:38 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:39.663644 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-308a9614-792c-4f83-a90b-cc62cfb39aee tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:39.664347 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-308a9614-792c-4f83-a90b-cc62cfb39aee tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:39.671559 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-308a9614-792c-4f83-a90b-cc62cfb39aee tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:39.672144 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-308a9614-792c-4f83-a90b-cc62cfb39aee tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:39.673083 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-308a9614-792c-4f83-a90b-cc62cfb39aee tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:39.673636 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-308a9614-792c-4f83-a90b-cc62cfb39aee tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:39.831379 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-308a9614-792c-4f83-a90b-cc62cfb39aee tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:39.838966 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-308a9614-792c-4f83-a90b-cc62cfb39aee tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1567 microversion: 2.1 time: 0.179334 Jun 16 19:52:39.840164 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 587/1155] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:39 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:39.909559 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2551b9bf-65eb-490c-ae82-4b7fc3996cb3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:39.910173 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2551b9bf-65eb-490c-ae82-4b7fc3996cb3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:39.929576 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2551b9bf-65eb-490c-ae82-4b7fc3996cb3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:39.929576 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2551b9bf-65eb-490c-ae82-4b7fc3996cb3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:39.929576 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2551b9bf-65eb-490c-ae82-4b7fc3996cb3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:39.929576 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2551b9bf-65eb-490c-ae82-4b7fc3996cb3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:40.048098 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2551b9bf-65eb-490c-ae82-4b7fc3996cb3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:40.055559 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2551b9bf-65eb-490c-ae82-4b7fc3996cb3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1362 microversion: 2.1 time: 0.149918 Jun 16 19:52:40.056132 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 569/1156] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:39 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:40.857678 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-77407c60-3e25-47f1-ad11-cc1871791ab4 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:40.858281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-77407c60-3e25-47f1-ad11-cc1871791ab4 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:40.865010 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-77407c60-3e25-47f1-ad11-cc1871791ab4 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:40.865466 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-77407c60-3e25-47f1-ad11-cc1871791ab4 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:40.866245 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-77407c60-3e25-47f1-ad11-cc1871791ab4 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:40.866684 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-77407c60-3e25-47f1-ad11-cc1871791ab4 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:40.999892 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-77407c60-3e25-47f1-ad11-cc1871791ab4 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:41.008824 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-77407c60-3e25-47f1-ad11-cc1871791ab4 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1567 microversion: 2.1 time: 0.155520 Jun 16 19:52:41.009425 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 588/1157] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:40 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:41.072621 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9bc2af28-9d1c-4fb1-aa1b-ffa760554328 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:41.073246 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9bc2af28-9d1c-4fb1-aa1b-ffa760554328 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:41.079735 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9bc2af28-9d1c-4fb1-aa1b-ffa760554328 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:41.080190 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9bc2af28-9d1c-4fb1-aa1b-ffa760554328 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:41.080952 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9bc2af28-9d1c-4fb1-aa1b-ffa760554328 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:41.081386 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9bc2af28-9d1c-4fb1-aa1b-ffa760554328 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:41.208195 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9bc2af28-9d1c-4fb1-aa1b-ffa760554328 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:41.216468 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9bc2af28-9d1c-4fb1-aa1b-ffa760554328 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1362 microversion: 2.1 time: 0.147702 Jun 16 19:52:41.221026 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 570/1158] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:41 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:42.026023 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f21615f8-0353-45cf-a80e-c3b38cf28656 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:42.027426 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f21615f8-0353-45cf-a80e-c3b38cf28656 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:42.029799 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=6 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:52:42.034545 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f21615f8-0353-45cf-a80e-c3b38cf28656 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:42.035085 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f21615f8-0353-45cf-a80e-c3b38cf28656 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:42.035842 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f21615f8-0353-45cf-a80e-c3b38cf28656 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:42.036270 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f21615f8-0353-45cf-a80e-c3b38cf28656 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:42.164265 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f21615f8-0353-45cf-a80e-c3b38cf28656 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:42.172394 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f21615f8-0353-45cf-a80e-c3b38cf28656 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1567 microversion: 2.1 time: 0.150152 Jun 16 19:52:42.172996 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 589/1159] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:42 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:42.234258 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-84cdf91a-8ba2-4db1-bd70-313a5f16eda3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:42.235028 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-84cdf91a-8ba2-4db1-bd70-313a5f16eda3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:42.237097 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:52:42.237876 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=6 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:52:42.243364 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84cdf91a-8ba2-4db1-bd70-313a5f16eda3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:42.243898 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84cdf91a-8ba2-4db1-bd70-313a5f16eda3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:42.244806 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84cdf91a-8ba2-4db1-bd70-313a5f16eda3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:42.245311 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84cdf91a-8ba2-4db1-bd70-313a5f16eda3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:42.382479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-84cdf91a-8ba2-4db1-bd70-313a5f16eda3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:42.391429 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-84cdf91a-8ba2-4db1-bd70-313a5f16eda3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1362 microversion: 2.1 time: 0.161492 Jun 16 19:52:42.392005 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 571/1160] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:42 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:42.573073 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-f05e6f01-47dc-462f-a247-69b5af92b5ef req-2c2fa92b-3be4-4013-9019-ffc9691e1e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e88f61-79c7-4911-a9e4-a0abdf11a512", "name": "network-vif-plugged", "status": "completed", "tag": "c79a35a0-41f6-4a23-a473-df78af5343e6"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:52:42.581533 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-f05e6f01-47dc-462f-a247-69b5af92b5ef req-2c2fa92b-3be4-4013-9019-ffc9691e1e51 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:42.581987 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-f05e6f01-47dc-462f-a247-69b5af92b5ef req-2c2fa92b-3be4-4013-9019-ffc9691e1e51 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:42.593240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-f05e6f01-47dc-462f-a247-69b5af92b5ef req-2c2fa92b-3be4-4013-9019-ffc9691e1e51 service nova] Creating event network-vif-plugged:c79a35a0-41f6-4a23-a473-df78af5343e6 for instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 on hv-cinder-84617 Jun 16 19:52:42.598190 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-f05e6f01-47dc-462f-a247-69b5af92b5ef req-2c2fa92b-3be4-4013-9019-ffc9691e1e51 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030360 Jun 16 19:52:42.598775 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 590/1161] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:52:43.191054 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d1ea8471-dede-4595-8bf2-903b1f4e865d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:43.199460 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d1ea8471-dede-4595-8bf2-903b1f4e865d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:43.199460 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d1ea8471-dede-4595-8bf2-903b1f4e865d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:43.199460 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d1ea8471-dede-4595-8bf2-903b1f4e865d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:43.199460 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d1ea8471-dede-4595-8bf2-903b1f4e865d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:43.199799 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d1ea8471-dede-4595-8bf2-903b1f4e865d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:43.329013 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d1ea8471-dede-4595-8bf2-903b1f4e865d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:43.336594 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d1ea8471-dede-4595-8bf2-903b1f4e865d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1567 microversion: 2.1 time: 0.150201 Jun 16 19:52:43.337149 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 572/1162] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:43 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:43.409579 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-4eb12300-cd53-46e1-b8f7-40441cfe3b48 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:43.410209 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-4eb12300-cd53-46e1-b8f7-40441cfe3b48 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:43.416770 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4eb12300-cd53-46e1-b8f7-40441cfe3b48 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:43.417222 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4eb12300-cd53-46e1-b8f7-40441cfe3b48 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:43.417989 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4eb12300-cd53-46e1-b8f7-40441cfe3b48 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:43.418426 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4eb12300-cd53-46e1-b8f7-40441cfe3b48 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:43.545861 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-4eb12300-cd53-46e1-b8f7-40441cfe3b48 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:43.553341 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-4eb12300-cd53-46e1-b8f7-40441cfe3b48 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1362 microversion: 2.1 time: 0.148432 Jun 16 19:52:43.553907 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 591/1163] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:43 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:44.353488 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-938087e3-9826-4f32-87ea-c210ef9ef24e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:44.354086 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-938087e3-9826-4f32-87ea-c210ef9ef24e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:44.360993 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-938087e3-9826-4f32-87ea-c210ef9ef24e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:44.361415 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-938087e3-9826-4f32-87ea-c210ef9ef24e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:44.362176 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-938087e3-9826-4f32-87ea-c210ef9ef24e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:44.362606 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-938087e3-9826-4f32-87ea-c210ef9ef24e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:44.492637 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-938087e3-9826-4f32-87ea-c210ef9ef24e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:44.500568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-938087e3-9826-4f32-87ea-c210ef9ef24e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1567 microversion: 2.1 time: 0.150993 Jun 16 19:52:44.501115 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 573/1164] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:44 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:44.570617 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7ba19b08-0bcd-45d1-872a-eb8934118228 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:44.571266 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-7ba19b08-0bcd-45d1-872a-eb8934118228 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:44.577825 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7ba19b08-0bcd-45d1-872a-eb8934118228 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:44.578271 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7ba19b08-0bcd-45d1-872a-eb8934118228 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:44.579054 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7ba19b08-0bcd-45d1-872a-eb8934118228 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:44.579489 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7ba19b08-0bcd-45d1-872a-eb8934118228 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:44.708215 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-7ba19b08-0bcd-45d1-872a-eb8934118228 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:44.716001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-7ba19b08-0bcd-45d1-872a-eb8934118228 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1362 microversion: 2.1 time: 0.149112 Jun 16 19:52:44.716791 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 592/1165] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:44 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:52:45.517958 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-be5f9206-1b42-4c48-b46e-e03fc55dd896 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:45.518595 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-be5f9206-1b42-4c48-b46e-e03fc55dd896 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:45.524965 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-be5f9206-1b42-4c48-b46e-e03fc55dd896 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:45.525406 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-be5f9206-1b42-4c48-b46e-e03fc55dd896 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:45.526159 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-be5f9206-1b42-4c48-b46e-e03fc55dd896 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:45.526586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-be5f9206-1b42-4c48-b46e-e03fc55dd896 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:45.654223 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-be5f9206-1b42-4c48-b46e-e03fc55dd896 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:45.661802 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-be5f9206-1b42-4c48-b46e-e03fc55dd896 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1567 microversion: 2.1 time: 0.147678 Jun 16 19:52:45.662371 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 574/1166] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:45 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:45.733773 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-4e88476d-1ccb-4ce6-a3ac-a2fdd4d9e267 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:45.734381 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-4e88476d-1ccb-4ce6-a3ac-a2fdd4d9e267 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:45.743372 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4e88476d-1ccb-4ce6-a3ac-a2fdd4d9e267 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:45.744051 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4e88476d-1ccb-4ce6-a3ac-a2fdd4d9e267 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:45.745215 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4e88476d-1ccb-4ce6-a3ac-a2fdd4d9e267 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:45.745725 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4e88476d-1ccb-4ce6-a3ac-a2fdd4d9e267 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:45.874770 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-4e88476d-1ccb-4ce6-a3ac-a2fdd4d9e267 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:45.882572 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-4e88476d-1ccb-4ce6-a3ac-a2fdd4d9e267 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1548 microversion: 2.1 time: 0.153148 Jun 16 19:52:45.883160 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 593/1167] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:45 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:45.899180 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1a49b729-e43a-4c40-b08d-1d74ee52999b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:45.899678 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1a49b729-e43a-4c40-b08d-1d74ee52999b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:45.906155 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a49b729-e43a-4c40-b08d-1d74ee52999b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:45.906613 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a49b729-e43a-4c40-b08d-1d74ee52999b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:45.907402 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a49b729-e43a-4c40-b08d-1d74ee52999b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:45.907842 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a49b729-e43a-4c40-b08d-1d74ee52999b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:45.983437 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1a49b729-e43a-4c40-b08d-1d74ee52999b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088048 Jun 16 19:52:45.984028 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 575/1168] 10.222.0.36 () {58 vars in 1274 bytes} [Thu Jun 16 19:52:45 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:52:46.678606 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3295ae4c-fd77-40f0-8100-27f86a014e33 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:46.679267 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-3295ae4c-fd77-40f0-8100-27f86a014e33 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:46.685744 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3295ae4c-fd77-40f0-8100-27f86a014e33 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:46.686185 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3295ae4c-fd77-40f0-8100-27f86a014e33 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:46.686966 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3295ae4c-fd77-40f0-8100-27f86a014e33 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:46.687399 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3295ae4c-fd77-40f0-8100-27f86a014e33 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:46.822374 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3295ae4c-fd77-40f0-8100-27f86a014e33 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:46.830096 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-3295ae4c-fd77-40f0-8100-27f86a014e33 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1567 microversion: 2.1 time: 0.155450 Jun 16 19:52:46.830785 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 594/1169] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:46 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:46.993119 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-955baf58-9172-4f87-88ea-88748b98ef8f req-3dcd3e28-d04a-4579-9b02-786613f49084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e88f61-79c7-4911-a9e4-a0abdf11a512", "tag": "c79a35a0-41f6-4a23-a473-df78af5343e6"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:52:47.001092 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-955baf58-9172-4f87-88ea-88748b98ef8f req-3dcd3e28-d04a-4579-9b02-786613f49084 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:47.001538 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-955baf58-9172-4f87-88ea-88748b98ef8f req-3dcd3e28-d04a-4579-9b02-786613f49084 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:47.012299 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-955baf58-9172-4f87-88ea-88748b98ef8f req-3dcd3e28-d04a-4579-9b02-786613f49084 service nova] Creating event network-changed:c79a35a0-41f6-4a23-a473-df78af5343e6 for instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 on hv-cinder-84617 Jun 16 19:52:47.017552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-955baf58-9172-4f87-88ea-88748b98ef8f req-3dcd3e28-d04a-4579-9b02-786613f49084 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028484 Jun 16 19:52:47.018143 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 576/1170] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:52:47.847985 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-743b7ed6-ace9-4879-99a3-285286e0616f tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:47.848654 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-743b7ed6-ace9-4879-99a3-285286e0616f tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:47.855332 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-743b7ed6-ace9-4879-99a3-285286e0616f tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:47.855781 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-743b7ed6-ace9-4879-99a3-285286e0616f tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:47.856580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-743b7ed6-ace9-4879-99a3-285286e0616f tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:47.857010 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-743b7ed6-ace9-4879-99a3-285286e0616f tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:48.244127 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-743b7ed6-ace9-4879-99a3-285286e0616f tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:48.252225 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-743b7ed6-ace9-4879-99a3-285286e0616f tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1567 microversion: 2.1 time: 0.408534 Jun 16 19:52:48.252792 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 595/1171] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:47 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1567 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:49.269561 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f40b9a58-3bad-440f-a649-90a23350346a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:49.270305 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f40b9a58-3bad-440f-a649-90a23350346a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:49.276380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f40b9a58-3bad-440f-a649-90a23350346a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:49.277386 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f40b9a58-3bad-440f-a649-90a23350346a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:49.278143 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f40b9a58-3bad-440f-a649-90a23350346a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:49.278574 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f40b9a58-3bad-440f-a649-90a23350346a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:49.409213 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f40b9a58-3bad-440f-a649-90a23350346a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:49.416626 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f40b9a58-3bad-440f-a649-90a23350346a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1567 microversion: 2.1 time: 0.151862 Jun 16 19:52:49.417778 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 577/1172] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:49 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:50.434364 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-534098a0-3b44-499d-b94a-48d1f0c008d1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:50.434904 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-534098a0-3b44-499d-b94a-48d1f0c008d1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:50.442153 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-534098a0-3b44-499d-b94a-48d1f0c008d1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:50.442606 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-534098a0-3b44-499d-b94a-48d1f0c008d1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:50.443418 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-534098a0-3b44-499d-b94a-48d1f0c008d1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:50.444310 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-534098a0-3b44-499d-b94a-48d1f0c008d1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:50.570421 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-534098a0-3b44-499d-b94a-48d1f0c008d1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:50.578091 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-534098a0-3b44-499d-b94a-48d1f0c008d1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1567 microversion: 2.1 time: 0.147701 Jun 16 19:52:50.578694 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 596/1173] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:50 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:51.595158 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-339b0adb-2647-4336-b6f8-cfd160976dad tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:51.595772 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-339b0adb-2647-4336-b6f8-cfd160976dad tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:51.602201 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-339b0adb-2647-4336-b6f8-cfd160976dad tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:51.602646 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-339b0adb-2647-4336-b6f8-cfd160976dad tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:51.603434 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-339b0adb-2647-4336-b6f8-cfd160976dad tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:51.603865 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-339b0adb-2647-4336-b6f8-cfd160976dad tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:51.736349 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-339b0adb-2647-4336-b6f8-cfd160976dad tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:51.744007 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-339b0adb-2647-4336-b6f8-cfd160976dad tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1567 microversion: 2.1 time: 0.152788 Jun 16 19:52:51.744636 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 578/1174] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:51 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:52.761917 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d6f78e54-f3ec-4c3c-be13-cca1365f9e1e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:52.763882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d6f78e54-f3ec-4c3c-be13-cca1365f9e1e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:52.769093 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d6f78e54-f3ec-4c3c-be13-cca1365f9e1e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:52.769536 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d6f78e54-f3ec-4c3c-be13-cca1365f9e1e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:52.770327 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d6f78e54-f3ec-4c3c-be13-cca1365f9e1e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:52.770757 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d6f78e54-f3ec-4c3c-be13-cca1365f9e1e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:52.901108 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d6f78e54-f3ec-4c3c-be13-cca1365f9e1e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:52.909078 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d6f78e54-f3ec-4c3c-be13-cca1365f9e1e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1508 microversion: 2.1 time: 0.151635 Jun 16 19:52:52.909637 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 597/1175] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:52 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:52.925206 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2cdc7c1d-a9f6-4669-81b9-26c899cd762b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:52:52.925784 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2cdc7c1d-a9f6-4669-81b9-26c899cd762b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:52.932288 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2cdc7c1d-a9f6-4669-81b9-26c899cd762b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:52.933224 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2cdc7c1d-a9f6-4669-81b9-26c899cd762b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:52.933978 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2cdc7c1d-a9f6-4669-81b9-26c899cd762b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:52.934414 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2cdc7c1d-a9f6-4669-81b9-26c899cd762b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:52.966946 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:52:53.155169 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2cdc7c1d-a9f6-4669-81b9-26c899cd762b tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "POST /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1/action" status: 202 len: 0 microversion: 2.1 time: 0.233789 Jun 16 19:52:53.155775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 579/1176] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Jun 16 19:52:52 2022] POST /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:52:53.163781 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0d3534a5-9f10-44e9-ba2e-f1d45a92e9aa tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:53.164489 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0d3534a5-9f10-44e9-ba2e-f1d45a92e9aa tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:53.170412 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0d3534a5-9f10-44e9-ba2e-f1d45a92e9aa tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:53.170863 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0d3534a5-9f10-44e9-ba2e-f1d45a92e9aa tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:53.171674 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0d3534a5-9f10-44e9-ba2e-f1d45a92e9aa tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:53.172124 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0d3534a5-9f10-44e9-ba2e-f1d45a92e9aa tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:53.302529 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0d3534a5-9f10-44e9-ba2e-f1d45a92e9aa tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:53.310584 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0d3534a5-9f10-44e9-ba2e-f1d45a92e9aa tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1516 microversion: 2.1 time: 0.150628 Jun 16 19:52:53.311190 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 598/1177] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:53 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:54.276353 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-0c004fb7-af0f-4ba9-b3d0-96293a2b6693 req-db95d5ba-e477-4fb4-ab98-696b3064d06e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0caba3-ed91-4ea7-a868-4f38cc779fc1", "name": "network-vif-unplugged", "status": "completed", "tag": "92634527-2839-4585-b57d-a54684637b9f"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:52:54.286042 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-0c004fb7-af0f-4ba9-b3d0-96293a2b6693 req-db95d5ba-e477-4fb4-ab98-696b3064d06e service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:54.286042 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-0c004fb7-af0f-4ba9-b3d0-96293a2b6693 req-db95d5ba-e477-4fb4-ab98-696b3064d06e service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:54.296248 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.compute.server_external_events [req-0c004fb7-af0f-4ba9-b3d0-96293a2b6693 req-db95d5ba-e477-4fb4-ab98-696b3064d06e service nova] Unable to find a host for instance 5b0caba3-ed91-4ea7-a868-4f38cc779fc1. Dropping event network-vif-unplugged {{(pid=124550) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 19:52:54.297100 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-0c004fb7-af0f-4ba9-b3d0-96293a2b6693 req-db95d5ba-e477-4fb4-ab98-696b3064d06e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025689 Jun 16 19:52:54.297674 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 580/1178] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 19:52:54.328023 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bf597b34-7a06-45de-9efb-6952e09b79c1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:54.328711 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-bf597b34-7a06-45de-9efb-6952e09b79c1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:54.335200 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bf597b34-7a06-45de-9efb-6952e09b79c1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:54.335652 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bf597b34-7a06-45de-9efb-6952e09b79c1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:54.336411 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bf597b34-7a06-45de-9efb-6952e09b79c1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:54.336849 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bf597b34-7a06-45de-9efb-6952e09b79c1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:54.469438 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-bf597b34-7a06-45de-9efb-6952e09b79c1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:54.476911 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-bf597b34-7a06-45de-9efb-6952e09b79c1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1518 microversion: 2.1 time: 0.152805 Jun 16 19:52:54.477478 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 599/1179] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:54 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:52:55.494822 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-34f1394a-367e-4b80-bf8d-8dd1d2da3df5 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:55.495472 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-34f1394a-367e-4b80-bf8d-8dd1d2da3df5 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:55.501864 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-34f1394a-367e-4b80-bf8d-8dd1d2da3df5 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:55.502339 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-34f1394a-367e-4b80-bf8d-8dd1d2da3df5 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:55.503131 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-34f1394a-367e-4b80-bf8d-8dd1d2da3df5 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:55.503575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-34f1394a-367e-4b80-bf8d-8dd1d2da3df5 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:55.636840 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-34f1394a-367e-4b80-bf8d-8dd1d2da3df5 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:55.644557 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-34f1394a-367e-4b80-bf8d-8dd1d2da3df5 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1574 microversion: 2.1 time: 0.153607 Jun 16 19:52:55.645122 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 581/1180] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:55 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:56.662163 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-ad2250df-dc13-4e15-ac94-547dad4eafc6 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:56.662766 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-ad2250df-dc13-4e15-ac94-547dad4eafc6 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:56.669254 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ad2250df-dc13-4e15-ac94-547dad4eafc6 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:56.669708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ad2250df-dc13-4e15-ac94-547dad4eafc6 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:56.670469 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ad2250df-dc13-4e15-ac94-547dad4eafc6 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:56.670951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ad2250df-dc13-4e15-ac94-547dad4eafc6 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:56.675071 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:52:56.799797 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ad2250df-dc13-4e15-ac94-547dad4eafc6 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:56.807574 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-ad2250df-dc13-4e15-ac94-547dad4eafc6 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1574 microversion: 2.1 time: 0.149160 Jun 16 19:52:56.808142 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 600/1181] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:56 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:57.825718 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-74233f54-3c6e-412a-bb33-c6f46cf1806a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:57.826322 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-74233f54-3c6e-412a-bb33-c6f46cf1806a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:57.832712 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74233f54-3c6e-412a-bb33-c6f46cf1806a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:57.833155 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74233f54-3c6e-412a-bb33-c6f46cf1806a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:57.833904 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74233f54-3c6e-412a-bb33-c6f46cf1806a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:57.834331 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74233f54-3c6e-412a-bb33-c6f46cf1806a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:57.963565 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-74233f54-3c6e-412a-bb33-c6f46cf1806a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:57.971109 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-74233f54-3c6e-412a-bb33-c6f46cf1806a tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1574 microversion: 2.1 time: 0.149657 Jun 16 19:52:57.973508 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 582/1182] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:57 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:52:58.987766 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-41806ef5-0c20-4c00-adb9-a6a9b50d68ed tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:52:58.988316 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-41806ef5-0c20-4c00-adb9-a6a9b50d68ed tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:52:58.990621 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:52:58.995905 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-41806ef5-0c20-4c00-adb9-a6a9b50d68ed tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:58.996358 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-41806ef5-0c20-4c00-adb9-a6a9b50d68ed tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:58.997118 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-41806ef5-0c20-4c00-adb9-a6a9b50d68ed tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:52:58.997540 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-41806ef5-0c20-4c00-adb9-a6a9b50d68ed tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:52:59.129572 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-41806ef5-0c20-4c00-adb9-a6a9b50d68ed tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:52:59.137240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-41806ef5-0c20-4c00-adb9-a6a9b50d68ed tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1574 microversion: 2.1 time: 0.153365 Jun 16 19:52:59.137870 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 601/1183] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:52:58 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:00.154039 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-77759ec2-3203-406a-8e2e-fdc12f0928d9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:00.154643 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-77759ec2-3203-406a-8e2e-fdc12f0928d9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:00.161046 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-77759ec2-3203-406a-8e2e-fdc12f0928d9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:00.161519 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-77759ec2-3203-406a-8e2e-fdc12f0928d9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:00.162305 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-77759ec2-3203-406a-8e2e-fdc12f0928d9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:00.162738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-77759ec2-3203-406a-8e2e-fdc12f0928d9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:00.295251 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-77759ec2-3203-406a-8e2e-fdc12f0928d9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:00.302714 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-77759ec2-3203-406a-8e2e-fdc12f0928d9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1574 microversion: 2.1 time: 0.153084 Jun 16 19:53:00.303299 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 583/1184] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:00 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:01.319878 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-ca23a913-0f03-4241-9d48-382df47efb5d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:01.320539 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-ca23a913-0f03-4241-9d48-382df47efb5d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:01.327667 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ca23a913-0f03-4241-9d48-382df47efb5d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:01.328231 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ca23a913-0f03-4241-9d48-382df47efb5d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:01.329121 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ca23a913-0f03-4241-9d48-382df47efb5d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:01.329556 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-ca23a913-0f03-4241-9d48-382df47efb5d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:01.457569 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-ca23a913-0f03-4241-9d48-382df47efb5d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:01.465569 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-ca23a913-0f03-4241-9d48-382df47efb5d tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1574 microversion: 2.1 time: 0.150450 Jun 16 19:53:01.466126 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 602/1185] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:01 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:02.481537 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d34fccff-3978-4109-aa09-d5db17f8df0c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:02.482158 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d34fccff-3978-4109-aa09-d5db17f8df0c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:02.487104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:53:02.489206 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d34fccff-3978-4109-aa09-d5db17f8df0c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:02.489658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d34fccff-3978-4109-aa09-d5db17f8df0c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:02.490453 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d34fccff-3978-4109-aa09-d5db17f8df0c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:02.490892 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d34fccff-3978-4109-aa09-d5db17f8df0c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:02.884146 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d34fccff-3978-4109-aa09-d5db17f8df0c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:02.892398 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d34fccff-3978-4109-aa09-d5db17f8df0c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1574 microversion: 2.1 time: 0.414802 Jun 16 19:53:02.892952 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 584/1186] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:02 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1574 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:03.909635 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d511ba35-c601-4a96-8fcd-f777fcc08b2c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:03.910254 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d511ba35-c601-4a96-8fcd-f777fcc08b2c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:03.916883 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d511ba35-c601-4a96-8fcd-f777fcc08b2c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:03.917335 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d511ba35-c601-4a96-8fcd-f777fcc08b2c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:03.918093 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d511ba35-c601-4a96-8fcd-f777fcc08b2c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:03.918530 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d511ba35-c601-4a96-8fcd-f777fcc08b2c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:04.045939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d511ba35-c601-4a96-8fcd-f777fcc08b2c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:04.053392 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d511ba35-c601-4a96-8fcd-f777fcc08b2c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1574 microversion: 2.1 time: 0.147689 Jun 16 19:53:04.053956 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 603/1187] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:03 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:53:05.070122 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5b5b6932-617b-45a6-97b2-b13529b78df9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:05.071140 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5b5b6932-617b-45a6-97b2-b13529b78df9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:05.077312 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5b5b6932-617b-45a6-97b2-b13529b78df9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:05.077772 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5b5b6932-617b-45a6-97b2-b13529b78df9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:05.078536 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5b5b6932-617b-45a6-97b2-b13529b78df9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:05.079011 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5b5b6932-617b-45a6-97b2-b13529b78df9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:05.205512 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5b5b6932-617b-45a6-97b2-b13529b78df9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:05.213030 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5b5b6932-617b-45a6-97b2-b13529b78df9 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1574 microversion: 2.1 time: 0.146749 Jun 16 19:53:05.214097 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 585/1188] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:05 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:06.231151 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5b1dbdac-95a6-4478-b9ab-8830cc70a655 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:06.231783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5b1dbdac-95a6-4478-b9ab-8830cc70a655 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:06.238599 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5b1dbdac-95a6-4478-b9ab-8830cc70a655 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:06.239082 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5b1dbdac-95a6-4478-b9ab-8830cc70a655 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:06.239854 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5b1dbdac-95a6-4478-b9ab-8830cc70a655 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:06.240294 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5b1dbdac-95a6-4478-b9ab-8830cc70a655 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:06.370685 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-f9f26d1d-1119-4feb-b985-424d85849985 req-fed82082-9a52-4a1f-995a-ef1cf9acd3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0caba3-ed91-4ea7-a868-4f38cc779fc1", "name": "network-vif-plugged", "status": "completed", "tag": "92634527-2839-4585-b57d-a54684637b9f"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:53:06.380326 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-f9f26d1d-1119-4feb-b985-424d85849985 req-fed82082-9a52-4a1f-995a-ef1cf9acd3b3 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:06.380766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-f9f26d1d-1119-4feb-b985-424d85849985 req-fed82082-9a52-4a1f-995a-ef1cf9acd3b3 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:06.382421 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5b1dbdac-95a6-4478-b9ab-8830cc70a655 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:06.390172 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5b1dbdac-95a6-4478-b9ab-8830cc70a655 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1574 microversion: 2.1 time: 0.163436 Jun 16 19:53:06.390750 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 604/1189] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:06 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:06.393624 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-f9f26d1d-1119-4feb-b985-424d85849985 req-fed82082-9a52-4a1f-995a-ef1cf9acd3b3 service nova] Creating event network-vif-plugged:92634527-2839-4585-b57d-a54684637b9f for instance 5b0caba3-ed91-4ea7-a868-4f38cc779fc1 on hv-cinder-84617 Jun 16 19:53:06.401742 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-f9f26d1d-1119-4feb-b985-424d85849985 req-fed82082-9a52-4a1f-995a-ef1cf9acd3b3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035896 Jun 16 19:53:06.402310 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 586/1190] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:53:07.407720 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6de5c5e5-b922-4b39-8f5d-1fcddc4d92d1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:07.408292 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6de5c5e5-b922-4b39-8f5d-1fcddc4d92d1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:07.414866 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6de5c5e5-b922-4b39-8f5d-1fcddc4d92d1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:07.415340 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6de5c5e5-b922-4b39-8f5d-1fcddc4d92d1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:07.416121 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6de5c5e5-b922-4b39-8f5d-1fcddc4d92d1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:07.417189 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6de5c5e5-b922-4b39-8f5d-1fcddc4d92d1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:07.549322 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6de5c5e5-b922-4b39-8f5d-1fcddc4d92d1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:07.556705 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6de5c5e5-b922-4b39-8f5d-1fcddc4d92d1 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1574 microversion: 2.1 time: 0.152883 Jun 16 19:53:07.557414 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 605/1191] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:07 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:08.575172 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a603a18d-c6b5-4435-aff9-015e8e830a5c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:08.575873 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a603a18d-c6b5-4435-aff9-015e8e830a5c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:08.581996 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a603a18d-c6b5-4435-aff9-015e8e830a5c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:08.582446 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a603a18d-c6b5-4435-aff9-015e8e830a5c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:08.583246 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a603a18d-c6b5-4435-aff9-015e8e830a5c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:08.583682 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a603a18d-c6b5-4435-aff9-015e8e830a5c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:08.713421 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a603a18d-c6b5-4435-aff9-015e8e830a5c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:08.721572 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a603a18d-c6b5-4435-aff9-015e8e830a5c tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1561 microversion: 2.1 time: 0.151714 Jun 16 19:53:08.722086 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 587/1192] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:08 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:22.824860 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5f5e7a3b-4e11-4754-80bc-692c29687bb1 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:22.825441 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5f5e7a3b-4e11-4754-80bc-692c29687bb1 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:22.827386 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=9 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:53:22.828087 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=34 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:53:22.833270 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5f5e7a3b-4e11-4754-80bc-692c29687bb1 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:22.844818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5f5e7a3b-4e11-4754-80bc-692c29687bb1 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:22.844818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5f5e7a3b-4e11-4754-80bc-692c29687bb1 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:22.844818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5f5e7a3b-4e11-4754-80bc-692c29687bb1 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:22.856874 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5f5e7a3b-4e11-4754-80bc-692c29687bb1 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512/ips" status: 200 len: 145 microversion: 2.1 time: 0.036052 Jun 16 19:53:22.857428 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 606/1193] 10.222.0.36 () {58 vars in 1247 bytes} [Thu Jun 16 19:53:22 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:53:25.695929 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a440201e-c2b8-456e-bc1b-0631428d2a67 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04e66e94-5859-4b0a-b1e5-f71d772b48bc"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:53:25.696990 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a440201e-c2b8-456e-bc1b-0631428d2a67 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:25.699273 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=7 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:53:25.699910 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:53:25.704571 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a440201e-c2b8-456e-bc1b-0631428d2a67 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:25.705006 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a440201e-c2b8-456e-bc1b-0631428d2a67 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:25.706340 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a440201e-c2b8-456e-bc1b-0631428d2a67 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:25.706771 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a440201e-c2b8-456e-bc1b-0631428d2a67 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:26.699681 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a440201e-c2b8-456e-bc1b-0631428d2a67 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "POST /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.007428 Jun 16 19:53:26.700346 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 588/1194] 10.222.0.36 () {60 vars in 1322 bytes} [Thu Jun 16 19:53:25 2022] POST /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512/os-volume_attachments => generated 194 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:53:35.250718 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-911c72a0-7e26-4a3a-abdf-4af916771510 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:53:35.258365 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-911c72a0-7e26-4a3a-abdf-4af916771510 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:35.258824 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-911c72a0-7e26-4a3a-abdf-4af916771510 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:35.319960 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-911c72a0-7e26-4a3a-abdf-4af916771510 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Going to try to stop instance {{(pid=124551) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 19:53:35.548430 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-911c72a0-7e26-4a3a-abdf-4af916771510 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "POST /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512/action" status: 202 len: 0 microversion: 2.1 time: 0.301285 Jun 16 19:53:35.551182 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 607/1195] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Jun 16 19:53:35 2022] POST /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:53:35.558909 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6a8c12ff-16f9-44bb-b2ab-919f1d32cc24 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:35.559630 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6a8c12ff-16f9-44bb-b2ab-919f1d32cc24 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:35.566833 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6a8c12ff-16f9-44bb-b2ab-919f1d32cc24 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:35.567354 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6a8c12ff-16f9-44bb-b2ab-919f1d32cc24 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:35.568120 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6a8c12ff-16f9-44bb-b2ab-919f1d32cc24 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:35.568560 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6a8c12ff-16f9-44bb-b2ab-919f1d32cc24 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:35.851949 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6a8c12ff-16f9-44bb-b2ab-919f1d32cc24 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:35.860285 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6a8c12ff-16f9-44bb-b2ab-919f1d32cc24 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1722 microversion: 2.1 time: 0.306338 Jun 16 19:53:35.860863 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 589/1196] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:35 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:36.879534 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-2cefac04-99ef-4a02-aaff-dbce1c422f50 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:36.880234 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-2cefac04-99ef-4a02-aaff-dbce1c422f50 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:36.886554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2cefac04-99ef-4a02-aaff-dbce1c422f50 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:36.887038 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2cefac04-99ef-4a02-aaff-dbce1c422f50 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:36.887803 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2cefac04-99ef-4a02-aaff-dbce1c422f50 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:36.888245 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2cefac04-99ef-4a02-aaff-dbce1c422f50 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:37.069243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-2cefac04-99ef-4a02-aaff-dbce1c422f50 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:37.077212 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-2cefac04-99ef-4a02-aaff-dbce1c422f50 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1722 microversion: 2.1 time: 0.202928 Jun 16 19:53:37.077768 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 608/1197] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:36 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:38.094902 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-02b71e90-128a-4f90-a813-c57d43f8539c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:38.095536 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-02b71e90-128a-4f90-a813-c57d43f8539c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:38.102104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-02b71e90-128a-4f90-a813-c57d43f8539c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:38.102555 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-02b71e90-128a-4f90-a813-c57d43f8539c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:38.103353 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-02b71e90-128a-4f90-a813-c57d43f8539c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:38.103794 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-02b71e90-128a-4f90-a813-c57d43f8539c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:38.233350 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-02b71e90-128a-4f90-a813-c57d43f8539c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:38.241791 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-02b71e90-128a-4f90-a813-c57d43f8539c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1722 microversion: 2.1 time: 0.150716 Jun 16 19:53:38.242358 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 590/1198] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:38 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:39.259204 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bc0c2d9b-c9bb-407b-8c9d-f2fd9a2d7cf7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:39.259818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-bc0c2d9b-c9bb-407b-8c9d-f2fd9a2d7cf7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:39.266311 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bc0c2d9b-c9bb-407b-8c9d-f2fd9a2d7cf7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:39.266758 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bc0c2d9b-c9bb-407b-8c9d-f2fd9a2d7cf7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:39.267580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bc0c2d9b-c9bb-407b-8c9d-f2fd9a2d7cf7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:39.268584 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bc0c2d9b-c9bb-407b-8c9d-f2fd9a2d7cf7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:39.391506 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-bc0c2d9b-c9bb-407b-8c9d-f2fd9a2d7cf7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:39.399384 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-bc0c2d9b-c9bb-407b-8c9d-f2fd9a2d7cf7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1722 microversion: 2.1 time: 0.144022 Jun 16 19:53:39.399944 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 609/1199] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:39 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1722 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:40.416878 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b14ccef9-28c9-441e-9cda-faa8daab429c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:40.417474 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b14ccef9-28c9-441e-9cda-faa8daab429c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:40.423794 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b14ccef9-28c9-441e-9cda-faa8daab429c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:40.424254 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b14ccef9-28c9-441e-9cda-faa8daab429c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:40.424994 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b14ccef9-28c9-441e-9cda-faa8daab429c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:40.425428 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b14ccef9-28c9-441e-9cda-faa8daab429c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:40.555139 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b14ccef9-28c9-441e-9cda-faa8daab429c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:40.563326 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b14ccef9-28c9-441e-9cda-faa8daab429c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1722 microversion: 2.1 time: 0.150373 Jun 16 19:53:40.564155 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 591/1200] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:40 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:41.581594 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-418d3cd4-3283-4e52-8a93-154e01ba62b3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:41.582205 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-418d3cd4-3283-4e52-8a93-154e01ba62b3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:41.588604 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-418d3cd4-3283-4e52-8a93-154e01ba62b3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:41.589053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-418d3cd4-3283-4e52-8a93-154e01ba62b3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:41.589816 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-418d3cd4-3283-4e52-8a93-154e01ba62b3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:41.590250 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-418d3cd4-3283-4e52-8a93-154e01ba62b3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:41.723126 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-418d3cd4-3283-4e52-8a93-154e01ba62b3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:41.731041 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-418d3cd4-3283-4e52-8a93-154e01ba62b3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1722 microversion: 2.1 time: 0.153757 Jun 16 19:53:41.731606 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 610/1201] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:41 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:42.748483 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a51db5b3-e95c-4848-b3c5-ec012e579e3d tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:42.749090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a51db5b3-e95c-4848-b3c5-ec012e579e3d tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:42.755661 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a51db5b3-e95c-4848-b3c5-ec012e579e3d tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:42.756105 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a51db5b3-e95c-4848-b3c5-ec012e579e3d tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:42.756859 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a51db5b3-e95c-4848-b3c5-ec012e579e3d tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:42.757292 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a51db5b3-e95c-4848-b3c5-ec012e579e3d tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:42.890321 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a51db5b3-e95c-4848-b3c5-ec012e579e3d tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:42.898175 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a51db5b3-e95c-4848-b3c5-ec012e579e3d tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1722 microversion: 2.1 time: 0.153598 Jun 16 19:53:42.898739 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 592/1202] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:42 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:43.915308 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9525986d-c35c-4423-934e-c215940b3662 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:43.915993 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9525986d-c35c-4423-934e-c215940b3662 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:43.922669 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9525986d-c35c-4423-934e-c215940b3662 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:43.923157 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9525986d-c35c-4423-934e-c215940b3662 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:43.924434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9525986d-c35c-4423-934e-c215940b3662 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:43.924875 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9525986d-c35c-4423-934e-c215940b3662 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:44.114747 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-9525986d-c35c-4423-934e-c215940b3662 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:44.122672 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9525986d-c35c-4423-934e-c215940b3662 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1722 microversion: 2.1 time: 0.211177 Jun 16 19:53:44.125406 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 611/1203] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:43 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:45.140773 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-61b95b15-1b82-444e-a893-5de65d944c87 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:45.141377 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-61b95b15-1b82-444e-a893-5de65d944c87 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:45.148329 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-61b95b15-1b82-444e-a893-5de65d944c87 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:45.148776 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-61b95b15-1b82-444e-a893-5de65d944c87 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:45.149533 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-61b95b15-1b82-444e-a893-5de65d944c87 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:45.149966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-61b95b15-1b82-444e-a893-5de65d944c87 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:45.276583 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-61b95b15-1b82-444e-a893-5de65d944c87 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:45.284438 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-61b95b15-1b82-444e-a893-5de65d944c87 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1722 microversion: 2.1 time: 0.147506 Jun 16 19:53:45.284998 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 593/1204] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:45 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:46.301658 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e018b48d-4368-495e-81fc-cf85b399f745 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:46.302266 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e018b48d-4368-495e-81fc-cf85b399f745 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:46.308781 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e018b48d-4368-495e-81fc-cf85b399f745 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:46.309224 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e018b48d-4368-495e-81fc-cf85b399f745 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:46.310010 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e018b48d-4368-495e-81fc-cf85b399f745 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:46.310439 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e018b48d-4368-495e-81fc-cf85b399f745 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:46.440386 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e018b48d-4368-495e-81fc-cf85b399f745 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:46.448326 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e018b48d-4368-495e-81fc-cf85b399f745 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1722 microversion: 2.1 time: 0.150518 Jun 16 19:53:46.448899 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 612/1205] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:46 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:47.465396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d2f89bbe-5800-4c17-87e5-f9faa0178532 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:47.466432 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d2f89bbe-5800-4c17-87e5-f9faa0178532 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:47.472887 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d2f89bbe-5800-4c17-87e5-f9faa0178532 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:47.473332 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d2f89bbe-5800-4c17-87e5-f9faa0178532 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:47.474089 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d2f89bbe-5800-4c17-87e5-f9faa0178532 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:47.474524 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d2f89bbe-5800-4c17-87e5-f9faa0178532 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:47.599966 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d2f89bbe-5800-4c17-87e5-f9faa0178532 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:47.607955 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d2f89bbe-5800-4c17-87e5-f9faa0178532 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1722 microversion: 2.1 time: 0.146517 Jun 16 19:53:47.608515 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 594/1206] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:47 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:48.627465 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c7d91380-a2a3-4886-affe-59c20e5c6c7e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:48.628071 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c7d91380-a2a3-4886-affe-59c20e5c6c7e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:48.635884 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c7d91380-a2a3-4886-affe-59c20e5c6c7e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:48.636334 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c7d91380-a2a3-4886-affe-59c20e5c6c7e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:48.637098 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c7d91380-a2a3-4886-affe-59c20e5c6c7e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:48.637547 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c7d91380-a2a3-4886-affe-59c20e5c6c7e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:48.775818 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c7d91380-a2a3-4886-affe-59c20e5c6c7e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:48.783782 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c7d91380-a2a3-4886-affe-59c20e5c6c7e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1722 microversion: 2.1 time: 0.162112 Jun 16 19:53:48.784382 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 613/1207] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:48 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:49.800502 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2fee6468-efe3-4e81-b3a1-7ef76863e6b7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:49.801113 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2fee6468-efe3-4e81-b3a1-7ef76863e6b7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:49.807577 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2fee6468-efe3-4e81-b3a1-7ef76863e6b7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:49.808027 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2fee6468-efe3-4e81-b3a1-7ef76863e6b7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:49.808785 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2fee6468-efe3-4e81-b3a1-7ef76863e6b7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:49.809221 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2fee6468-efe3-4e81-b3a1-7ef76863e6b7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:49.938746 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2fee6468-efe3-4e81-b3a1-7ef76863e6b7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:49.946570 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2fee6468-efe3-4e81-b3a1-7ef76863e6b7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1722 microversion: 2.1 time: 0.149970 Jun 16 19:53:49.947165 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 595/1208] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:49 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:50.962777 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-378a86c5-6c90-4aea-a718-555a777d5b78 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:50.963415 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-378a86c5-6c90-4aea-a718-555a777d5b78 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:50.969908 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-378a86c5-6c90-4aea-a718-555a777d5b78 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:50.970357 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-378a86c5-6c90-4aea-a718-555a777d5b78 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:50.971168 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-378a86c5-6c90-4aea-a718-555a777d5b78 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:50.971608 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-378a86c5-6c90-4aea-a718-555a777d5b78 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:51.105000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-378a86c5-6c90-4aea-a718-555a777d5b78 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:51.113803 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-378a86c5-6c90-4aea-a718-555a777d5b78 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1722 microversion: 2.1 time: 0.154877 Jun 16 19:53:51.114374 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 614/1209] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:50 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:52.131618 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-60cc8974-302d-4295-816e-5c1021112d97 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:52.132229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-60cc8974-302d-4295-816e-5c1021112d97 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:52.138885 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-60cc8974-302d-4295-816e-5c1021112d97 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:52.139375 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-60cc8974-302d-4295-816e-5c1021112d97 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:52.140144 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-60cc8974-302d-4295-816e-5c1021112d97 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:52.140586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-60cc8974-302d-4295-816e-5c1021112d97 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:52.267426 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-60cc8974-302d-4295-816e-5c1021112d97 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:52.275404 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-60cc8974-302d-4295-816e-5c1021112d97 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1699 microversion: 2.1 time: 0.148213 Jun 16 19:53:52.275977 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 596/1210] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:52 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1699 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:52.291643 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-cca074e9-3ebb-4878-9e40-16a5def01442 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:53:52.298175 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cca074e9-3ebb-4878-9e40-16a5def01442 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:52.298623 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cca074e9-3ebb-4878-9e40-16a5def01442 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:52.321297 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-cca074e9-3ebb-4878-9e40-16a5def01442 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Going to try to start instance {{(pid=124551) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 19:53:52.738206 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-cca074e9-3ebb-4878-9e40-16a5def01442 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "POST /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512/action" status: 202 len: 0 microversion: 2.1 time: 0.450272 Jun 16 19:53:52.739422 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 615/1211] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Jun 16 19:53:52 2022] POST /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:53:52.747514 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cfce5056-68c2-4818-819f-38160380a507 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:52.748169 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-cfce5056-68c2-4818-819f-38160380a507 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:52.754475 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cfce5056-68c2-4818-819f-38160380a507 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:52.754951 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cfce5056-68c2-4818-819f-38160380a507 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:52.755725 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cfce5056-68c2-4818-819f-38160380a507 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:52.756167 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cfce5056-68c2-4818-819f-38160380a507 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:52.886863 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cfce5056-68c2-4818-819f-38160380a507 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:52.895382 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cfce5056-68c2-4818-819f-38160380a507 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1708 microversion: 2.1 time: 0.151262 Jun 16 19:53:52.895942 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 597/1212] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:52 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:53.913474 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8a1d9351-3be0-4c12-aacd-64c72539d063 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:53.914171 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8a1d9351-3be0-4c12-aacd-64c72539d063 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:53.920341 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8a1d9351-3be0-4c12-aacd-64c72539d063 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:53.920788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8a1d9351-3be0-4c12-aacd-64c72539d063 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:53.921544 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8a1d9351-3be0-4c12-aacd-64c72539d063 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:53.921975 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8a1d9351-3be0-4c12-aacd-64c72539d063 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:54.046884 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8a1d9351-3be0-4c12-aacd-64c72539d063 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:54.054752 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8a1d9351-3be0-4c12-aacd-64c72539d063 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1708 microversion: 2.1 time: 0.145949 Jun 16 19:53:54.055347 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 616/1213] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:53 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1708 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:53:55.072331 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-539a625e-3864-4a1c-aa7c-4a1400e67a5e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:53:55.072946 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-539a625e-3864-4a1c-aa7c-4a1400e67a5e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:53:55.079394 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-539a625e-3864-4a1c-aa7c-4a1400e67a5e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:55.079847 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-539a625e-3864-4a1c-aa7c-4a1400e67a5e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:55.080607 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-539a625e-3864-4a1c-aa7c-4a1400e67a5e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:53:55.081046 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-539a625e-3864-4a1c-aa7c-4a1400e67a5e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:53:55.214195 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-539a625e-3864-4a1c-aa7c-4a1400e67a5e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:53:55.222192 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-539a625e-3864-4a1c-aa7c-4a1400e67a5e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1712 microversion: 2.1 time: 0.153752 Jun 16 19:53:55.222762 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 598/1214] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:53:55 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1712 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:54:27.995439 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-9fe26477-2036-4b37-ab62-a19988081fd8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:27.996075 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-9fe26477-2036-4b37-ab62-a19988081fd8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:27.998373 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=22 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:54:27.999069 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:54:28.003902 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9fe26477-2036-4b37-ab62-a19988081fd8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:28.004355 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9fe26477-2036-4b37-ab62-a19988081fd8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:28.005124 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9fe26477-2036-4b37-ab62-a19988081fd8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:28.005572 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-9fe26477-2036-4b37-ab62-a19988081fd8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:28.086155 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-9fe26477-2036-4b37-ab62-a19988081fd8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lazy-loading 'services' on Instance uuid 10e88f61-79c7-4911-a9e4-a0abdf11a512 {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:54:28.231184 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ebcee31a-682f-4839-94de-f841e037776e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:28.231184 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ebcee31a-682f-4839-94de-f841e037776e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:28.232021 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=22 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:54:28.232707 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:54:28.237481 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebcee31a-682f-4839-94de-f841e037776e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:28.237935 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebcee31a-682f-4839-94de-f841e037776e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:28.238695 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebcee31a-682f-4839-94de-f841e037776e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:28.239187 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebcee31a-682f-4839-94de-f841e037776e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:28.266072 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ebcee31a-682f-4839-94de-f841e037776e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Going to try to terminate instance {{(pid=124550) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:54:28.293419 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-9fe26477-2036-4b37-ab62-a19988081fd8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "DELETE /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512/os-volume_attachments/04e66e94-5859-4b0a-b1e5-f71d772b48bc" status: 202 len: 0 microversion: 2.1 time: 0.301002 Jun 16 19:54:28.294265 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 617/1215] 10.222.0.36 () {58 vars in 1415 bytes} [Thu Jun 16 19:54:27 2022] DELETE /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512/os-volume_attachments/04e66e94-5859-4b0a-b1e5-f71d772b48bc => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:54:28.381659 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-3eefc667-3e46-4a12-b82c-dfd2cd7eb6e8 req-947508fd-2c1c-42c0-8d40-8c51251102f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b0caba3-ed91-4ea7-a868-4f38cc779fc1", "tag": "92634527-2839-4585-b57d-a54684637b9f"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:54:28.390987 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-3eefc667-3e46-4a12-b82c-dfd2cd7eb6e8 req-947508fd-2c1c-42c0-8d40-8c51251102f0 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:28.391951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-3eefc667-3e46-4a12-b82c-dfd2cd7eb6e8 req-947508fd-2c1c-42c0-8d40-8c51251102f0 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:28.404286 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-3eefc667-3e46-4a12-b82c-dfd2cd7eb6e8 req-947508fd-2c1c-42c0-8d40-8c51251102f0 service nova] Creating event network-changed:92634527-2839-4585-b57d-a54684637b9f for instance 5b0caba3-ed91-4ea7-a868-4f38cc779fc1 on hv-cinder-84617 Jun 16 19:54:28.409385 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-3eefc667-3e46-4a12-b82c-dfd2cd7eb6e8 req-947508fd-2c1c-42c0-8d40-8c51251102f0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113002 Jun 16 19:54:28.414954 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 618/1216] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:54:28.595644 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ebcee31a-682f-4839-94de-f841e037776e tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 204 len: 0 microversion: 2.1 time: 0.370645 Jun 16 19:54:28.596277 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 599/1217] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:54:28 2022] DELETE /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:54:28.604853 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3c04c228-ef84-4589-91e9-ee17cafd4167 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:28.605686 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-3c04c228-ef84-4589-91e9-ee17cafd4167 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:28.611945 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3c04c228-ef84-4589-91e9-ee17cafd4167 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:28.612480 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3c04c228-ef84-4589-91e9-ee17cafd4167 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:28.613252 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3c04c228-ef84-4589-91e9-ee17cafd4167 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:28.613695 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3c04c228-ef84-4589-91e9-ee17cafd4167 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:28.747502 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3c04c228-ef84-4589-91e9-ee17cafd4167 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:54:28.755024 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-3c04c228-ef84-4589-91e9-ee17cafd4167 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1567 microversion: 2.1 time: 0.154298 Jun 16 19:54:28.755785 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 619/1218] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:54:28 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:54:29.774417 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-54622d58-2e67-4760-a424-39f3416b1bef tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:29.775158 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-54622d58-2e67-4760-a424-39f3416b1bef tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:29.782109 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54622d58-2e67-4760-a424-39f3416b1bef tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:29.782553 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54622d58-2e67-4760-a424-39f3416b1bef tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:29.783346 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54622d58-2e67-4760-a424-39f3416b1bef tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:29.783784 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54622d58-2e67-4760-a424-39f3416b1bef tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:29.910773 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-54622d58-2e67-4760-a424-39f3416b1bef tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:54:29.918185 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-54622d58-2e67-4760-a424-39f3416b1bef tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1567 microversion: 2.1 time: 0.147983 Jun 16 19:54:29.918737 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 600/1219] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:54:29 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:54:30.936193 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a1f759a6-cefa-4476-ae34-890586817c12 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:30.936749 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a1f759a6-cefa-4476-ae34-890586817c12 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:30.943711 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1f759a6-cefa-4476-ae34-890586817c12 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:30.944187 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1f759a6-cefa-4476-ae34-890586817c12 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:30.945082 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1f759a6-cefa-4476-ae34-890586817c12 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:30.945533 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a1f759a6-cefa-4476-ae34-890586817c12 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:31.025259 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a1f759a6-cefa-4476-ae34-890586817c12 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:54:31.030237 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a1f759a6-cefa-4476-ae34-890586817c12 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1382 microversion: 2.1 time: 0.098483 Jun 16 19:54:31.030803 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 620/1220] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:54:30 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1382 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:54:31.127980 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-3f3e5c3e-9d3e-401e-8cc9-0a4973f1f719 req-e04613f4-178c-4c68-8606-3bb5c5a2c980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0caba3-ed91-4ea7-a868-4f38cc779fc1", "name": "network-vif-deleted", "tag": "92634527-2839-4585-b57d-a54684637b9f"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:54:31.136082 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-3f3e5c3e-9d3e-401e-8cc9-0a4973f1f719 req-e04613f4-178c-4c68-8606-3bb5c5a2c980 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:31.136950 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-3f3e5c3e-9d3e-401e-8cc9-0a4973f1f719 req-e04613f4-178c-4c68-8606-3bb5c5a2c980 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:31.147651 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-3f3e5c3e-9d3e-401e-8cc9-0a4973f1f719 req-e04613f4-178c-4c68-8606-3bb5c5a2c980 service nova] Creating event network-vif-deleted:92634527-2839-4585-b57d-a54684637b9f for instance 5b0caba3-ed91-4ea7-a868-4f38cc779fc1 on hv-cinder-84617 Jun 16 19:54:31.152560 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-3f3e5c3e-9d3e-401e-8cc9-0a4973f1f719 req-e04613f4-178c-4c68-8606-3bb5c5a2c980 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087857 Jun 16 19:54:31.153142 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 601/1221] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:54:31.524392 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f1bc0bb9-7312-4bfc-a2f8-e2f07b9f9304 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:54:31.531116 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f1bc0bb9-7312-4bfc-a2f8-e2f07b9f9304 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:31.531625 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f1bc0bb9-7312-4bfc-a2f8-e2f07b9f9304 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:31.553706 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f1bc0bb9-7312-4bfc-a2f8-e2f07b9f9304 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Going to try to stop instance {{(pid=124551) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 19:54:31.786762 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f1bc0bb9-7312-4bfc-a2f8-e2f07b9f9304 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "POST /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512/action" status: 202 len: 0 microversion: 2.1 time: 0.266388 Jun 16 19:54:31.789510 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 621/1222] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Jun 16 19:54:31 2022] POST /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:54:31.796422 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-210e27ca-e41e-4779-ae06-141aef8abf20 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:31.797143 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-210e27ca-e41e-4779-ae06-141aef8abf20 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:31.804275 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-210e27ca-e41e-4779-ae06-141aef8abf20 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:31.804726 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-210e27ca-e41e-4779-ae06-141aef8abf20 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:31.805559 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-210e27ca-e41e-4779-ae06-141aef8abf20 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:31.805994 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-210e27ca-e41e-4779-ae06-141aef8abf20 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:31.938117 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-210e27ca-e41e-4779-ae06-141aef8abf20 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:54:31.945775 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-210e27ca-e41e-4779-ae06-141aef8abf20 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1676 microversion: 2.1 time: 0.154040 Jun 16 19:54:31.946336 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 602/1223] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:54:31 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:54:32.047862 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-17808dca-220a-4aee-93f0-940657fce67f tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:32.048478 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-17808dca-220a-4aee-93f0-940657fce67f tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:32.055120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-17808dca-220a-4aee-93f0-940657fce67f tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:32.055562 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-17808dca-220a-4aee-93f0-940657fce67f tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:32.056309 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-17808dca-220a-4aee-93f0-940657fce67f tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:32.056739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-17808dca-220a-4aee-93f0-940657fce67f tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:32.088162 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-17808dca-220a-4aee-93f0-940657fce67f tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:32.088603 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-17808dca-220a-4aee-93f0-940657fce67f tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:32.089043 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-17808dca-220a-4aee-93f0-940657fce67f tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lazy-loading 'fault' on Instance uuid 5b0caba3-ed91-4ea7-a868-4f38cc779fc1 {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:54:32.129804 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-17808dca-220a-4aee-93f0-940657fce67f tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab96fb75e716433f857cb9a4c0d7fb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6329f898314d44d2b6c264d8224a8c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:54:32.137802 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-17808dca-220a-4aee-93f0-940657fce67f tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 200 len: 1224 microversion: 2.1 time: 0.094265 Jun 16 19:54:32.144711 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 622/1224] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:54:32 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:54:32.963440 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-20dc7244-290e-4f8a-8802-d1173cbc110c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:32.964051 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-20dc7244-290e-4f8a-8802-d1173cbc110c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:32.970426 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-20dc7244-290e-4f8a-8802-d1173cbc110c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:32.970881 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-20dc7244-290e-4f8a-8802-d1173cbc110c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:32.971670 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-20dc7244-290e-4f8a-8802-d1173cbc110c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:32.972110 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-20dc7244-290e-4f8a-8802-d1173cbc110c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:33.095444 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-20dc7244-290e-4f8a-8802-d1173cbc110c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:54:33.102803 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-20dc7244-290e-4f8a-8802-d1173cbc110c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1676 microversion: 2.1 time: 0.143179 Jun 16 19:54:33.103397 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 603/1225] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:54:32 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1676 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:54:33.154776 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7e0962cd-f45d-44d8-823a-8dff9851a1b6 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:33.155417 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-7e0962cd-f45d-44d8-823a-8dff9851a1b6 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] [instance: 5b0caba3-ed91-4ea7-a868-4f38cc779fc1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:33.161705 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7e0962cd-f45d-44d8-823a-8dff9851a1b6 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:33.162151 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7e0962cd-f45d-44d8-823a-8dff9851a1b6 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:33.162946 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7e0962cd-f45d-44d8-823a-8dff9851a1b6 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:33.163388 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7e0962cd-f45d-44d8-823a-8dff9851a1b6 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:33.176823 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-7e0962cd-f45d-44d8-823a-8dff9851a1b6 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] HTTP exception thrown: Instance 5b0caba3-ed91-4ea7-a868-4f38cc779fc1 could not be found. Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7e0962cd-f45d-44d8-823a-8dff9851a1b6 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Request method failure captured: Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 HTTP/1.1 Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4lWzILopQuKOlDAM0KxQvJEj4tlm9eHAp3H2FPXRZhqdhFPdbYuzgWs8oFW6NERDV5udYqbOUEsG36sC9VjSmumcI69redoOV8lMAR_Ya6KpeuebloL5C9FEMHM7NxxLDIl3smkOLRb7q-BdoH8CVMg8zgQ5dSYkjy1l0xQOlmQny0 Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 6329f898314d44d2b6c264d8224a8c46 Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-TestShelveInstance-688552362 Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:54:33.178856 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:54:33.180679 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6329f898314d44d2b6c264d8224a8c46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6329f898314d44d2b6c264d8224a8c46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6329f898314d44d2b6c264d8224a8c46", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6329f898314d44d2b6c264d8224a8c46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:54:33.180679 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-TestShelveInstance-688552362 Jun 16 19:54:33.180679 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 6329f898314d44d2b6c264d8224a8c46 Jun 16 19:54:33.180679 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-TestShelveInstance-688552362 Jun 16 19:54:33.180679 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-TestShelveInstance-688552362-project Jun 16 19:54:33.180679 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:54:33.180679 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:54:33.180679 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: ab96fb75e716433f857cb9a4c0d7fb2a Jun 16 19:54:33.180679 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-TestShelveInstance-688552362-project Jun 16 19:54:33.180679 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:54:33.180679 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance 5b0caba3-ed91-4ea7-a868-4f38cc779fc1 could not be found. Jun 16 19:54:33.180679 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': '5b0caba3-ed91-4ea7-a868-4f38cc779fc1'} Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b0caba3-ed91-4ea7-a868-4f38cc779fc1 could not be found. Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:54:33.181580 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:54:33.183059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:54:33.183059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:54:33.183059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:54:33.183059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:54:33.183059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:54:33.183059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:54:33.183059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:54:33.183059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b0caba3-ed91-4ea7-a868-4f38cc779fc1 could not be found. Jun 16 19:54:33.183059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:54:33.183059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:54:33.183059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:54:33.183059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:54:33.183059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:54:33.183059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:54:33.183059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:54:33.183059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:54:33.183059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b0caba3-ed91-4ea7-a868-4f38cc779fc1 could not be found. Jun 16 19:54:33.183059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:54:33.185051 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7e0962cd-f45d-44d8-823a-8dff9851a1b6 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Returning 404 to user: Instance 5b0caba3-ed91-4ea7-a868-4f38cc779fc1 could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:54:33.185051 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-7e0962cd-f45d-44d8-823a-8dff9851a1b6 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1" status: 404 len: 111 microversion: 2.1 time: 0.029308 Jun 16 19:54:33.185051 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 623/1226] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:54:33 2022] GET /compute/v2.1/servers/5b0caba3-ed91-4ea7-a868-4f38cc779fc1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:54:33.410635 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1d484989-3101-43c1-ab47-b953a5e996d5 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] Calling method '.version_select at 0x7f0505cfa0d0>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:33.470523 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1d484989-3101-43c1-ab47-b953a5e996d5 tempest-TestShelveInstance-688552362 tempest-TestShelveInstance-688552362-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-555335683" status: 202 len: 0 microversion: 2.1 time: 0.063610 Jun 16 19:54:33.471181 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 604/1227] 10.222.0.36 () {58 vars in 1250 bytes} [Thu Jun 16 19:54:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-555335683 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:54:34.119918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8d44e990-f40d-4d6b-9a38-9f92f99435e3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:34.120519 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8d44e990-f40d-4d6b-9a38-9f92f99435e3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:34.126642 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8d44e990-f40d-4d6b-9a38-9f92f99435e3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:34.127114 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8d44e990-f40d-4d6b-9a38-9f92f99435e3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:34.127861 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8d44e990-f40d-4d6b-9a38-9f92f99435e3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:34.128287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8d44e990-f40d-4d6b-9a38-9f92f99435e3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:34.260993 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-8d44e990-f40d-4d6b-9a38-9f92f99435e3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:54:34.269203 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8d44e990-f40d-4d6b-9a38-9f92f99435e3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1676 microversion: 2.1 time: 0.153118 Jun 16 19:54:34.269762 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 624/1228] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:54:34 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:54:35.287454 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-078f543b-e30a-4bea-9390-29a19d6a390a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:35.288062 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-078f543b-e30a-4bea-9390-29a19d6a390a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:35.294893 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-078f543b-e30a-4bea-9390-29a19d6a390a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:35.295374 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-078f543b-e30a-4bea-9390-29a19d6a390a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:35.296145 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-078f543b-e30a-4bea-9390-29a19d6a390a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:35.296603 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-078f543b-e30a-4bea-9390-29a19d6a390a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:35.516339 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-078f543b-e30a-4bea-9390-29a19d6a390a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:54:35.524432 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-078f543b-e30a-4bea-9390-29a19d6a390a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1676 microversion: 2.1 time: 0.241453 Jun 16 19:54:35.525092 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 605/1229] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:54:35 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:54:36.542520 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6a1da311-4973-4e70-b056-21a2dcf749b9 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:36.543181 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6a1da311-4973-4e70-b056-21a2dcf749b9 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:36.550406 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6a1da311-4973-4e70-b056-21a2dcf749b9 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:36.550867 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6a1da311-4973-4e70-b056-21a2dcf749b9 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:36.551715 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6a1da311-4973-4e70-b056-21a2dcf749b9 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:36.552162 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6a1da311-4973-4e70-b056-21a2dcf749b9 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:36.689458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6a1da311-4973-4e70-b056-21a2dcf749b9 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:54:36.697823 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6a1da311-4973-4e70-b056-21a2dcf749b9 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1676 microversion: 2.1 time: 0.159961 Jun 16 19:54:36.698385 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 625/1230] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:54:36 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:54:37.715190 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-760e0b46-7542-4a1c-b3f0-7a2748c4d528 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:37.715859 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-760e0b46-7542-4a1c-b3f0-7a2748c4d528 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:37.723090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-760e0b46-7542-4a1c-b3f0-7a2748c4d528 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:37.723485 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-760e0b46-7542-4a1c-b3f0-7a2748c4d528 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:37.724259 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-760e0b46-7542-4a1c-b3f0-7a2748c4d528 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:37.724693 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-760e0b46-7542-4a1c-b3f0-7a2748c4d528 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:37.853913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-760e0b46-7542-4a1c-b3f0-7a2748c4d528 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:54:37.862165 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-760e0b46-7542-4a1c-b3f0-7a2748c4d528 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1676 microversion: 2.1 time: 0.150841 Jun 16 19:54:37.862777 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 606/1231] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:54:37 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:54:38.883227 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-14ad020b-9f7e-4fbd-84aa-73a85e5544be tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:38.884645 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-14ad020b-9f7e-4fbd-84aa-73a85e5544be tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:38.895796 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-14ad020b-9f7e-4fbd-84aa-73a85e5544be tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:38.896560 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-14ad020b-9f7e-4fbd-84aa-73a85e5544be tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:38.897829 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-14ad020b-9f7e-4fbd-84aa-73a85e5544be tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:38.898581 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-14ad020b-9f7e-4fbd-84aa-73a85e5544be tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:39.116405 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-14ad020b-9f7e-4fbd-84aa-73a85e5544be tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:54:39.125340 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-14ad020b-9f7e-4fbd-84aa-73a85e5544be tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1676 microversion: 2.1 time: 0.248387 Jun 16 19:54:39.125920 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 626/1232] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:54:38 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1676 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:54:40.142830 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a88aed7d-976d-4952-82f2-367251e24bd8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:40.143474 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a88aed7d-976d-4952-82f2-367251e24bd8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:40.156244 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a88aed7d-976d-4952-82f2-367251e24bd8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:40.156782 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a88aed7d-976d-4952-82f2-367251e24bd8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:40.158674 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a88aed7d-976d-4952-82f2-367251e24bd8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:40.160223 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a88aed7d-976d-4952-82f2-367251e24bd8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:40.330688 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a88aed7d-976d-4952-82f2-367251e24bd8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:54:40.338334 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a88aed7d-976d-4952-82f2-367251e24bd8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1676 microversion: 2.1 time: 0.199946 Jun 16 19:54:40.341130 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 607/1233] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:54:40 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1676 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:54:41.357380 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5f5a848a-f95f-44dc-81f3-a974181cc5e3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:41.357994 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5f5a848a-f95f-44dc-81f3-a974181cc5e3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:41.364949 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5f5a848a-f95f-44dc-81f3-a974181cc5e3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:41.365401 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5f5a848a-f95f-44dc-81f3-a974181cc5e3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:41.366240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5f5a848a-f95f-44dc-81f3-a974181cc5e3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:41.366683 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5f5a848a-f95f-44dc-81f3-a974181cc5e3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:41.497391 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5f5a848a-f95f-44dc-81f3-a974181cc5e3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:54:41.505141 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5f5a848a-f95f-44dc-81f3-a974181cc5e3 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1676 microversion: 2.1 time: 0.152233 Jun 16 19:54:41.505704 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 627/1234] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:54:41 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:54:42.522622 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e93c1f50-2a8c-4fd7-af19-4823a461ec6c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:42.526901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e93c1f50-2a8c-4fd7-af19-4823a461ec6c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:42.530321 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e93c1f50-2a8c-4fd7-af19-4823a461ec6c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:42.530770 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e93c1f50-2a8c-4fd7-af19-4823a461ec6c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:42.531559 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e93c1f50-2a8c-4fd7-af19-4823a461ec6c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:42.531992 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e93c1f50-2a8c-4fd7-af19-4823a461ec6c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:42.669761 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e93c1f50-2a8c-4fd7-af19-4823a461ec6c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:54:42.677232 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e93c1f50-2a8c-4fd7-af19-4823a461ec6c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1653 microversion: 2.1 time: 0.158555 Jun 16 19:54:42.677714 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 608/1235] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:54:42 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1653 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:54:42.693721 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-87184e96-41d2-4861-9d03-8599709e395b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:54:42.700486 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-87184e96-41d2-4861-9d03-8599709e395b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:42.700949 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-87184e96-41d2-4861-9d03-8599709e395b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:42.723719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-87184e96-41d2-4861-9d03-8599709e395b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Going to try to start instance {{(pid=124551) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 19:54:42.953464 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-87184e96-41d2-4861-9d03-8599709e395b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "POST /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512/action" status: 202 len: 0 microversion: 2.1 time: 0.263632 Jun 16 19:54:42.954068 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 628/1236] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Jun 16 19:54:42 2022] POST /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:54:42.962268 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-54eca558-7868-4c18-8e95-610a2699cb0c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:42.969913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-54eca558-7868-4c18-8e95-610a2699cb0c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:42.969913 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54eca558-7868-4c18-8e95-610a2699cb0c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:42.970160 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54eca558-7868-4c18-8e95-610a2699cb0c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:42.970698 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54eca558-7868-4c18-8e95-610a2699cb0c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:42.971159 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54eca558-7868-4c18-8e95-610a2699cb0c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:43.103099 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-54eca558-7868-4c18-8e95-610a2699cb0c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:54:43.111507 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-54eca558-7868-4c18-8e95-610a2699cb0c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1662 microversion: 2.1 time: 0.153053 Jun 16 19:54:43.112278 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 609/1237] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:54:42 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:54:44.130582 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-4a1f7dc3-cbe6-4107-8a4f-f91545554c10 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:44.131308 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-4a1f7dc3-cbe6-4107-8a4f-f91545554c10 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:44.137737 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4a1f7dc3-cbe6-4107-8a4f-f91545554c10 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:44.138177 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4a1f7dc3-cbe6-4107-8a4f-f91545554c10 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:44.139012 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4a1f7dc3-cbe6-4107-8a4f-f91545554c10 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:44.139449 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-4a1f7dc3-cbe6-4107-8a4f-f91545554c10 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:44.270712 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-4a1f7dc3-cbe6-4107-8a4f-f91545554c10 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:54:44.279371 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-4a1f7dc3-cbe6-4107-8a4f-f91545554c10 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1662 microversion: 2.1 time: 0.153739 Jun 16 19:54:44.279871 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 629/1238] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:54:44 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:54:45.297562 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a9db2080-ed2b-41d1-b8da-1148de8c1eff tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:45.298438 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a9db2080-ed2b-41d1-b8da-1148de8c1eff tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:45.305081 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a9db2080-ed2b-41d1-b8da-1148de8c1eff tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:45.305620 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a9db2080-ed2b-41d1-b8da-1148de8c1eff tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:45.306629 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a9db2080-ed2b-41d1-b8da-1148de8c1eff tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:45.307198 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a9db2080-ed2b-41d1-b8da-1148de8c1eff tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:45.599600 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a9db2080-ed2b-41d1-b8da-1148de8c1eff tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:54:45.608381 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a9db2080-ed2b-41d1-b8da-1148de8c1eff tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1662 microversion: 2.1 time: 0.315286 Jun 16 19:54:45.615123 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 610/1239] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:54:45 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1662 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:54:46.626872 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-2489418c-4c02-4014-ac61-af52fcbaffd0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:54:46.635684 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-2489418c-4c02-4014-ac61-af52fcbaffd0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:54:46.636560 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2489418c-4c02-4014-ac61-af52fcbaffd0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:46.637018 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2489418c-4c02-4014-ac61-af52fcbaffd0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:46.638369 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2489418c-4c02-4014-ac61-af52fcbaffd0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:54:46.638806 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2489418c-4c02-4014-ac61-af52fcbaffd0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:54:46.793495 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-2489418c-4c02-4014-ac61-af52fcbaffd0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:54:46.803808 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-2489418c-4c02-4014-ac61-af52fcbaffd0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1666 microversion: 2.1 time: 0.181598 Jun 16 19:54:46.818083 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 630/1240] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:54:46 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1666 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:54:56.360357 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:54:56.361066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:54:56.526109 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d737a21f-650b-4147-90ab-5b21b1ce75f2 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Action: 'create', calling method: .version_select at 0x7f0505c91940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1913068007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQgZZ/yecV8I2XTCgyXYGK07i3AUTc9RIinzWmMVef+czgDRRFHuu9QjtTllTmYewTzLFtXe93HGwKyFwqFofr9zZzipnuQ71qQqYuQko4aECW7EPZtkXgDGGSQWTNS0A=="}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:54:56.532368 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-d737a21f-650b-4147-90ab-5b21b1ce75f2 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Getting quotas for project 6e652ff475764534b6cc03cb64b7d069. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:54:56.536469 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-d737a21f-650b-4147-90ab-5b21b1ce75f2 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Getting quotas for user 19fc9ffd436d4068a89686da8b4f2997 and project 6e652ff475764534b6cc03cb64b7d069. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:54:56.768625 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d737a21f-650b-4147-90ab-5b21b1ce75f2 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.413842 Jun 16 19:54:56.769225 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 611/1241] 10.222.0.36 () {60 vars in 1158 bytes} [Thu Jun 16 19:54:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:55:17.921030 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-04f5fd90-cc0c-43e7-94f2-9002a5f38841 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1547154016", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1913068007", "security_groups": [{"name": "tempest-secgroup-smoke-715222250"}], "block_device_mapping_v2": [{"uuid": "90d5d9c2-3803-4538-96c3-0e54f0454f99", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ef179745-884d-48cf-ae3f-2f015474cf3f"}]}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:55:17.929313 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=30 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:55:17.929959 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:55:18.030430 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.network.neutron [None req-04f5fd90-cc0c-43e7-94f2-9002a5f38841 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] validate_networks() for [('ef179745-884d-48cf-ae3f-2f015474cf3f', None, None, None, None, None)] {{(pid=124551) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:55:18.482779 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-04f5fd90-cc0c-43e7-94f2-9002a5f38841 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Flavor limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:55:18.483236 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-04f5fd90-cc0c-43e7-94f2-9002a5f38841 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Image limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:55:18.483705 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-04f5fd90-cc0c-43e7-94f2-9002a5f38841 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Flavor pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:55:18.484111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-04f5fd90-cc0c-43e7-94f2-9002a5f38841 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Image pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:55:18.484519 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-04f5fd90-cc0c-43e7-94f2-9002a5f38841 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:55:18.493231 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-04f5fd90-cc0c-43e7-94f2-9002a5f38841 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:18.493670 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-04f5fd90-cc0c-43e7-94f2-9002a5f38841 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:18.494451 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-04f5fd90-cc0c-43e7-94f2-9002a5f38841 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:18.494880 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-04f5fd90-cc0c-43e7-94f2-9002a5f38841 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:18.512231 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-04f5fd90-cc0c-43e7-94f2-9002a5f38841 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Getting quotas for project 6e652ff475764534b6cc03cb64b7d069. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:55:18.516761 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-04f5fd90-cc0c-43e7-94f2-9002a5f38841 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Getting quotas for user 19fc9ffd436d4068a89686da8b4f2997 and project 6e652ff475764534b6cc03cb64b7d069. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:55:18.573201 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-04f5fd90-cc0c-43e7-94f2-9002a5f38841 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Going to run 1 instances... {{(pid=124551) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:55:18.575319 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-04f5fd90-cc0c-43e7-94f2-9002a5f38841 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='90d5d9c2-3803-4538-96c3-0e54f0454f99',volume_size=None,volume_type=None)] {{(pid=124551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:55:18.988024 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR oslo.messaging._drivers.impl_rabbit [None req-04f5fd90-cc0c-43e7-94f2-9002a5f38841 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [9f7cc6ad-0c9a-427f-b380-97a980e9debc] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 19:55:19.992537 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=4 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:55:19.995882 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO oslo.messaging._drivers.impl_rabbit [None req-04f5fd90-cc0c-43e7-94f2-9002a5f38841 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [9f7cc6ad-0c9a-427f-b380-97a980e9debc] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 34584. Jun 16 19:55:19.998128 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4a56dbb1-3bca-4eb9-ae09-7e8ee0af61a6 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:19.999088 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4a56dbb1-3bca-4eb9-ae09-7e8ee0af61a6 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:20.000305 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-04f5fd90-cc0c-43e7-94f2-9002a5f38841 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.083715 Jun 16 19:55:20.001288 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 631/1242] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:55:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 2085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:55:20.006795 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a56dbb1-3bca-4eb9-ae09-7e8ee0af61a6 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:20.009092 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a56dbb1-3bca-4eb9-ae09-7e8ee0af61a6 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:20.009092 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a56dbb1-3bca-4eb9-ae09-7e8ee0af61a6 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:20.009092 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a56dbb1-3bca-4eb9-ae09-7e8ee0af61a6 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:20.018504 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f9310792-37f9-45ea-bbdf-2dba4cf5d377 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:20.019167 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f9310792-37f9-45ea-bbdf-2dba4cf5d377 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:20.038104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4a56dbb1-3bca-4eb9-ae09-7e8ee0af61a6 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046797 Jun 16 19:55:20.038667 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 612/1243] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:55:19 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 19:55:20.074808 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-f9310792-37f9-45ea-bbdf-2dba4cf5d377 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:20.087591 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f9310792-37f9-45ea-bbdf-2dba4cf5d377 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1095 microversion: 2.1 time: 0.068474 Jun 16 19:55:20.087591 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 632/1244] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:20 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:20.097635 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d29487d0-0e19-4b9c-bfd7-6a8be575edd4 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:20.098143 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d29487d0-0e19-4b9c-bfd7-6a8be575edd4 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:20.105091 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d29487d0-0e19-4b9c-bfd7-6a8be575edd4 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:20.105546 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d29487d0-0e19-4b9c-bfd7-6a8be575edd4 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:20.106319 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d29487d0-0e19-4b9c-bfd7-6a8be575edd4 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:20.107163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d29487d0-0e19-4b9c-bfd7-6a8be575edd4 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:20.131557 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d29487d0-0e19-4b9c-bfd7-6a8be575edd4 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Going to try to terminate instance {{(pid=124550) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:55:20.468404 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d29487d0-0e19-4b9c-bfd7-6a8be575edd4 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "DELETE /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 204 len: 0 microversion: 2.1 time: 0.374645 Jun 16 19:55:20.469245 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 613/1245] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:55:20 2022] DELETE /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:55:20.478430 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-afc12ca9-1585-43bb-935d-93258fde075b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:20.479107 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-afc12ca9-1585-43bb-935d-93258fde075b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:20.486682 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-afc12ca9-1585-43bb-935d-93258fde075b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:20.487163 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-afc12ca9-1585-43bb-935d-93258fde075b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:20.487998 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-afc12ca9-1585-43bb-935d-93258fde075b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:20.488538 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-afc12ca9-1585-43bb-935d-93258fde075b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:20.614626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-afc12ca9-1585-43bb-935d-93258fde075b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:20.622102 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-afc12ca9-1585-43bb-935d-93258fde075b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1672 microversion: 2.1 time: 0.148542 Jun 16 19:55:20.622660 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 633/1246] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:20 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:21.099760 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8de2e15b-945f-4c4b-b249-36fbc78488b2 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:21.108079 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8de2e15b-945f-4c4b-b249-36fbc78488b2 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:21.153372 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8de2e15b-945f-4c4b-b249-36fbc78488b2 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:21.161422 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8de2e15b-945f-4c4b-b249-36fbc78488b2 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1095 microversion: 2.1 time: 0.065806 Jun 16 19:55:21.162194 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 614/1247] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:21 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:21.640303 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b17de24a-ec95-4314-b4d1-f636f31dee82 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:21.640917 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b17de24a-ec95-4314-b4d1-f636f31dee82 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:21.647374 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b17de24a-ec95-4314-b4d1-f636f31dee82 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:21.647829 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b17de24a-ec95-4314-b4d1-f636f31dee82 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:21.648589 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b17de24a-ec95-4314-b4d1-f636f31dee82 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:21.649029 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b17de24a-ec95-4314-b4d1-f636f31dee82 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:21.775594 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b17de24a-ec95-4314-b4d1-f636f31dee82 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:21.786484 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b17de24a-ec95-4314-b4d1-f636f31dee82 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1672 microversion: 2.1 time: 0.150615 Jun 16 19:55:21.787089 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 634/1248] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:21 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:22.177495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-855ef981-f2b1-4133-b4c5-a50523afe92c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:22.178131 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-855ef981-f2b1-4133-b4c5-a50523afe92c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:22.230802 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-855ef981-f2b1-4133-b4c5-a50523afe92c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:22.237411 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-855ef981-f2b1-4133-b4c5-a50523afe92c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1095 microversion: 2.1 time: 0.063708 Jun 16 19:55:22.238008 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 615/1249] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:22 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:22.803447 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3e000279-4c6f-453b-a4dc-e6071096c759 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:22.804165 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-3e000279-4c6f-453b-a4dc-e6071096c759 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:22.811219 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3e000279-4c6f-453b-a4dc-e6071096c759 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:22.811668 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3e000279-4c6f-453b-a4dc-e6071096c759 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:22.812421 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3e000279-4c6f-453b-a4dc-e6071096c759 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:22.812850 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3e000279-4c6f-453b-a4dc-e6071096c759 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:22.945250 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3e000279-4c6f-453b-a4dc-e6071096c759 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:22.952800 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-3e000279-4c6f-453b-a4dc-e6071096c759 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1672 microversion: 2.1 time: 0.153257 Jun 16 19:55:22.953367 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 635/1250] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:22 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:23.253535 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4845c06e-7af4-4a9e-96db-31fbb214218f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:23.254240 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4845c06e-7af4-4a9e-96db-31fbb214218f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:23.338595 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4845c06e-7af4-4a9e-96db-31fbb214218f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:23.346013 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4845c06e-7af4-4a9e-96db-31fbb214218f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1095 microversion: 2.1 time: 0.096265 Jun 16 19:55:23.346583 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 616/1251] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:23 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1095 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:23.529845 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-f45131ca-fe1c-4e5a-bc76-91e5dad4e844 req-025ca737-d776-4bb1-99ef-8bddfa09c95b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e88f61-79c7-4911-a9e4-a0abdf11a512", "name": "network-vif-deleted", "tag": "c79a35a0-41f6-4a23-a473-df78af5343e6"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:55:23.538008 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-f45131ca-fe1c-4e5a-bc76-91e5dad4e844 req-025ca737-d776-4bb1-99ef-8bddfa09c95b service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:23.542144 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-f45131ca-fe1c-4e5a-bc76-91e5dad4e844 req-025ca737-d776-4bb1-99ef-8bddfa09c95b service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:23.549980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-f45131ca-fe1c-4e5a-bc76-91e5dad4e844 req-025ca737-d776-4bb1-99ef-8bddfa09c95b service nova] Creating event network-vif-deleted:c79a35a0-41f6-4a23-a473-df78af5343e6 for instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 on hv-cinder-84617 Jun 16 19:55:23.556198 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-f45131ca-fe1c-4e5a-bc76-91e5dad4e844 req-025ca737-d776-4bb1-99ef-8bddfa09c95b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030167 Jun 16 19:55:23.556808 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 636/1252] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:55:23.632829 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:55:23.633079 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Thu Jun 16 19:55:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:55:23.969669 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9a9b51b3-878e-463e-a9e1-fff4c99f199f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:23.970288 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9a9b51b3-878e-463e-a9e1-fff4c99f199f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:23.978911 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9a9b51b3-878e-463e-a9e1-fff4c99f199f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:23.979388 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9a9b51b3-878e-463e-a9e1-fff4c99f199f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:23.980163 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9a9b51b3-878e-463e-a9e1-fff4c99f199f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:23.980596 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9a9b51b3-878e-463e-a9e1-fff4c99f199f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:24.013351 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9a9b51b3-878e-463e-a9e1-fff4c99f199f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:24.013715 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9a9b51b3-878e-463e-a9e1-fff4c99f199f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:24.014165 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-9a9b51b3-878e-463e-a9e1-fff4c99f199f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lazy-loading 'fault' on Instance uuid 10e88f61-79c7-4911-a9e4-a0abdf11a512 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:55:24.054393 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9a9b51b3-878e-463e-a9e1-fff4c99f199f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:24.063425 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9a9b51b3-878e-463e-a9e1-fff4c99f199f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 200 len: 1327 microversion: 2.1 time: 0.096702 Jun 16 19:55:24.064346 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 617/1253] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:23 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:24.364532 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c7bb2a56-1dd7-4075-b789-be4c3d18395c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:24.365235 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c7bb2a56-1dd7-4075-b789-be4c3d18395c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:24.371739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c7bb2a56-1dd7-4075-b789-be4c3d18395c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:24.372183 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c7bb2a56-1dd7-4075-b789-be4c3d18395c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:24.372947 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c7bb2a56-1dd7-4075-b789-be4c3d18395c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:24.373396 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c7bb2a56-1dd7-4075-b789-be4c3d18395c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:24.438386 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c7bb2a56-1dd7-4075-b789-be4c3d18395c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:24.446193 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c7bb2a56-1dd7-4075-b789-be4c3d18395c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1145 microversion: 2.1 time: 0.086438 Jun 16 19:55:24.448824 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 637/1254] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:24 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:25.081414 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-23b68eee-a2fd-4b81-bbe4-e147867854d2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:25.082066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-23b68eee-a2fd-4b81-bbe4-e147867854d2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:25.088431 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-23b68eee-a2fd-4b81-bbe4-e147867854d2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:25.088882 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-23b68eee-a2fd-4b81-bbe4-e147867854d2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:25.089645 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-23b68eee-a2fd-4b81-bbe4-e147867854d2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:25.090083 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-23b68eee-a2fd-4b81-bbe4-e147867854d2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:25.103971 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-23b68eee-a2fd-4b81-bbe4-e147867854d2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] HTTP exception thrown: Instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 could not be found. Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-23b68eee-a2fd-4b81-bbe4-e147867854d2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Request method failure captured: Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 HTTP/1.1 Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4n71jdLLlXCyYOPPKqI7T6Cdy-LbAhN31Iw20cgKuY4Ry-3m1V4Pwfdm75FIQbFO5ZuJ-O4GBFbOPX-BZG7U9iM-m1DjpPcdR-Tax9Y17Yq9i3ptRxg6fPm3kFdQhFUFX3gr3NZR3NwBVBrOPLK5AgDwY3kHf5KCAEiLPVQkdMccD4 Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 7caa2a2f7c644b16a76b9dff92a2b2e8 Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeTestJSON-112593294 Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:55:25.105601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:55:25.108073 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7caa2a2f7c644b16a76b9dff92a2b2e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7caa2a2f7c644b16a76b9dff92a2b2e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7caa2a2f7c644b16a76b9dff92a2b2e8", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7caa2a2f7c644b16a76b9dff92a2b2e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:55:25.108073 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeTestJSON-112593294 Jun 16 19:55:25.108073 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 7caa2a2f7c644b16a76b9dff92a2b2e8 Jun 16 19:55:25.108073 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeTestJSON-112593294 Jun 16 19:55:25.108073 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeTestJSON-112593294-project Jun 16 19:55:25.108073 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:55:25.108073 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:55:25.108073 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 0251939fa06a45da898a12a37ac91163 Jun 16 19:55:25.108073 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeTestJSON-112593294-project Jun 16 19:55:25.108073 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:55:25.108073 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 could not be found. Jun 16 19:55:25.108073 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': '10e88f61-79c7-4911-a9e4-a0abdf11a512'} Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 could not be found. Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:55:25.109090 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:55:25.110660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:55:25.110660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:55:25.110660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:55:25.110660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:55:25.110660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:55:25.110660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:55:25.110660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:55:25.110660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 could not be found. Jun 16 19:55:25.110660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:55:25.110660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:55:25.110660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:55:25.110660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:55:25.110660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:55:25.110660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:55:25.110660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:55:25.110660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:55:25.110660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 could not be found. Jun 16 19:55:25.110660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:55:25.112376 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-23b68eee-a2fd-4b81-bbe4-e147867854d2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Returning 404 to user: Instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:55:25.112376 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-23b68eee-a2fd-4b81-bbe4-e147867854d2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 404 len: 111 microversion: 2.1 time: 0.029467 Jun 16 19:55:25.112376 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 618/1255] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:25 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:55:25.116480 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-442f2620-da5e-47d5-a4cb-d78c961b06b1 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '.version_select at 0x7f0501602af0>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:25.197388 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-442f2620-da5e-47d5-a4cb-d78c961b06b1 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-956652141" status: 202 len: 0 microversion: 2.1 time: 0.084334 Jun 16 19:55:25.197976 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 638/1256] 10.222.0.36 () {58 vars in 1217 bytes} [Thu Jun 16 19:55:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-956652141 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:55:25.466380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ad6f9b2c-0b7c-4ad6-963d-f73342827bb6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:25.466380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ad6f9b2c-0b7c-4ad6-963d-f73342827bb6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:25.473791 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad6f9b2c-0b7c-4ad6-963d-f73342827bb6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:25.474248 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad6f9b2c-0b7c-4ad6-963d-f73342827bb6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:25.475055 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad6f9b2c-0b7c-4ad6-963d-f73342827bb6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:25.481178 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad6f9b2c-0b7c-4ad6-963d-f73342827bb6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:25.559065 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ad6f9b2c-0b7c-4ad6-963d-f73342827bb6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:25.567254 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ad6f9b2c-0b7c-4ad6-963d-f73342827bb6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1145 microversion: 2.1 time: 0.107719 Jun 16 19:55:25.568131 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 619/1257] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:25 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1145 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:26.019917 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-dc280d22-68f9-4db3-aa4d-fa0c23d5674f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Action: 'create', calling method: .version_select at 0x7f0505cf7e50>, body: {"keypair": {"name": "tempest-keypair-1668126497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARPrGvgTyakcvDqDA+xIJSTNmzzjAOCzs50OSy9BIbkhrt19mJlRIpSDRZEMevwUB+kDV4OiBcES6MByqJ3fy2b4agpf4fKOjM5z4vn0Yxprcev6jkC0NNpZEz+M2sOVg=="}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:55:26.036737 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-dc280d22-68f9-4db3-aa4d-fa0c23d5674f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Getting quotas for project 7caa2a2f7c644b16a76b9dff92a2b2e8. Resources: {'key_pairs'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:55:26.041168 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-dc280d22-68f9-4db3-aa4d-fa0c23d5674f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Getting quotas for user 0251939fa06a45da898a12a37ac91163 and project 7caa2a2f7c644b16a76b9dff92a2b2e8. Resources: {'key_pairs'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:55:26.140136 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-dc280d22-68f9-4db3-aa4d-fa0c23d5674f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124971 Jun 16 19:55:26.140732 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 639/1258] 10.222.0.36 () {60 vars in 1158 bytes} [Thu Jun 16 19:55:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:55:26.584837 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fcd7c817-9145-49c6-9278-73dc3776fb9e tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:26.585432 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fcd7c817-9145-49c6-9278-73dc3776fb9e tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:26.592507 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fcd7c817-9145-49c6-9278-73dc3776fb9e tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:26.592949 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fcd7c817-9145-49c6-9278-73dc3776fb9e tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:26.593711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fcd7c817-9145-49c6-9278-73dc3776fb9e tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:26.594142 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fcd7c817-9145-49c6-9278-73dc3776fb9e tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:26.679713 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fcd7c817-9145-49c6-9278-73dc3776fb9e tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:26.688305 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fcd7c817-9145-49c6-9278-73dc3776fb9e tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1201 microversion: 2.1 time: 0.107461 Jun 16 19:55:26.688963 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 620/1259] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:26 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1201 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:27.723963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-31393657-d494-4997-b5ae-1fc09e2f4c2c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:27.724601 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-31393657-d494-4997-b5ae-1fc09e2f4c2c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:27.751319 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-31393657-d494-4997-b5ae-1fc09e2f4c2c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:27.751777 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-31393657-d494-4997-b5ae-1fc09e2f4c2c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:27.752597 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-31393657-d494-4997-b5ae-1fc09e2f4c2c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:27.753037 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-31393657-d494-4997-b5ae-1fc09e2f4c2c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:27.989294 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-31393657-d494-4997-b5ae-1fc09e2f4c2c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:27.999545 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-31393657-d494-4997-b5ae-1fc09e2f4c2c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1278 microversion: 2.1 time: 0.295663 Jun 16 19:55:28.001456 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 640/1260] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:27 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1278 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:28.536422 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-b87c035d-b2bf-45d9-99de-658e701e79e5 req-0c668402-9c21-4ba5-b90a-ba98c02fe0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1", "tag": "26f4f314-2ae9-4591-86be-783a8b8117d6"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:55:28.556456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-b87c035d-b2bf-45d9-99de-658e701e79e5 req-0c668402-9c21-4ba5-b90a-ba98c02fe0a4 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:28.556456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-b87c035d-b2bf-45d9-99de-658e701e79e5 req-0c668402-9c21-4ba5-b90a-ba98c02fe0a4 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:28.563735 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-b87c035d-b2bf-45d9-99de-658e701e79e5 req-0c668402-9c21-4ba5-b90a-ba98c02fe0a4 service nova] Creating event network-changed:26f4f314-2ae9-4591-86be-783a8b8117d6 for instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 on hv-cinder-84617 Jun 16 19:55:28.568884 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-b87c035d-b2bf-45d9-99de-658e701e79e5 req-0c668402-9c21-4ba5-b90a-ba98c02fe0a4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043542 Jun 16 19:55:28.569474 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 621/1261] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:55:28.741541 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-426e6f09-5842-4a0b-86d2-a1e5837a5837 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1553449763", "imageRef": "9fcb2be6-02db-4853-a8d6-6478a75f26a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7117fea0-e71e-4ef8-a249-78145283a66c"}], "security_groups": [{"name": "tempest-securitygroup--1207940723"}], "key_name": "tempest-keypair-1668126497", "user_data": "}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:55:28.751590 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=2 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:55:28.855800 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.network.neutron [None req-426e6f09-5842-4a0b-86d2-a1e5837a5837 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] validate_networks() for [('7117fea0-e71e-4ef8-a249-78145283a66c', None, None, None, None, None)] {{(pid=124551) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:55:29.018916 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-76c87ba1-4db7-48ad-bcbb-9ea1508a9b91 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:29.019952 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-76c87ba1-4db7-48ad-bcbb-9ea1508a9b91 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:29.026396 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-76c87ba1-4db7-48ad-bcbb-9ea1508a9b91 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:29.027131 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-76c87ba1-4db7-48ad-bcbb-9ea1508a9b91 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:29.027910 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-76c87ba1-4db7-48ad-bcbb-9ea1508a9b91 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:29.028349 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-76c87ba1-4db7-48ad-bcbb-9ea1508a9b91 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:29.232727 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-426e6f09-5842-4a0b-86d2-a1e5837a5837 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Flavor limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:55:29.233153 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-426e6f09-5842-4a0b-86d2-a1e5837a5837 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Image limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:55:29.233630 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-426e6f09-5842-4a0b-86d2-a1e5837a5837 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Flavor pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:55:29.234043 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-426e6f09-5842-4a0b-86d2-a1e5837a5837 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Image pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:55:29.234458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-426e6f09-5842-4a0b-86d2-a1e5837a5837 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:55:29.243646 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-76c87ba1-4db7-48ad-bcbb-9ea1508a9b91 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:29.245615 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-426e6f09-5842-4a0b-86d2-a1e5837a5837 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:29.246143 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-426e6f09-5842-4a0b-86d2-a1e5837a5837 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:29.247053 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-426e6f09-5842-4a0b-86d2-a1e5837a5837 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:29.247550 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-426e6f09-5842-4a0b-86d2-a1e5837a5837 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:29.251889 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-76c87ba1-4db7-48ad-bcbb-9ea1508a9b91 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1266 microversion: 2.1 time: 0.237396 Jun 16 19:55:29.252578 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 622/1262] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:29 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:29.264889 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-426e6f09-5842-4a0b-86d2-a1e5837a5837 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Getting quotas for project 7caa2a2f7c644b16a76b9dff92a2b2e8. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:55:29.268986 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-426e6f09-5842-4a0b-86d2-a1e5837a5837 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Getting quotas for user 0251939fa06a45da898a12a37ac91163 and project 7caa2a2f7c644b16a76b9dff92a2b2e8. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:55:29.279943 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-426e6f09-5842-4a0b-86d2-a1e5837a5837 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Going to run 1 instances... {{(pid=124551) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:55:29.282230 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-426e6f09-5842-4a0b-86d2-a1e5837a5837 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fcb2be6-02db-4853-a8d6-6478a75f26a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:55:29.437917 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-426e6f09-5842-4a0b-86d2-a1e5837a5837 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.700741 Jun 16 19:55:29.438732 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 641/1263] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:55:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:55:29.448607 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ba929ec0-f883-429e-b2f5-13c525a66535 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:29.449212 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ba929ec0-f883-429e-b2f5-13c525a66535 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:29.504933 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ba929ec0-f883-429e-b2f5-13c525a66535 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:29.511921 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ba929ec0-f883-429e-b2f5-13c525a66535 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 200 len: 1238 microversion: 2.1 time: 0.067036 Jun 16 19:55:29.512596 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 623/1264] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:29 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:30.269507 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a9e0a49a-130a-449c-958c-33f86e1b6bf0 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:30.270483 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a9e0a49a-130a-449c-958c-33f86e1b6bf0 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:30.276700 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a9e0a49a-130a-449c-958c-33f86e1b6bf0 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:30.277532 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a9e0a49a-130a-449c-958c-33f86e1b6bf0 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:30.277964 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a9e0a49a-130a-449c-958c-33f86e1b6bf0 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:30.278404 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a9e0a49a-130a-449c-958c-33f86e1b6bf0 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:30.408793 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a9e0a49a-130a-449c-958c-33f86e1b6bf0 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:30.416390 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a9e0a49a-130a-449c-958c-33f86e1b6bf0 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1266 microversion: 2.1 time: 0.151386 Jun 16 19:55:30.416957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 642/1265] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:30 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:30.528751 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-90184a22-8a31-45db-949d-0340bf5e8f41 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:30.529283 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-90184a22-8a31-45db-949d-0340bf5e8f41 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:30.535815 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90184a22-8a31-45db-949d-0340bf5e8f41 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:30.536267 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90184a22-8a31-45db-949d-0340bf5e8f41 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:30.537018 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90184a22-8a31-45db-949d-0340bf5e8f41 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:30.537456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90184a22-8a31-45db-949d-0340bf5e8f41 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:30.596756 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-90184a22-8a31-45db-949d-0340bf5e8f41 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:30.604184 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-90184a22-8a31-45db-949d-0340bf5e8f41 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 200 len: 1242 microversion: 2.1 time: 0.079385 Jun 16 19:55:30.604743 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 624/1266] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:30 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:31.433312 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-44b7e70e-9951-4280-b776-90f9b7064f6a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:31.433859 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-44b7e70e-9951-4280-b776-90f9b7064f6a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:31.440403 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-44b7e70e-9951-4280-b776-90f9b7064f6a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:31.440857 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-44b7e70e-9951-4280-b776-90f9b7064f6a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:31.441627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-44b7e70e-9951-4280-b776-90f9b7064f6a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:31.442073 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-44b7e70e-9951-4280-b776-90f9b7064f6a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:31.574141 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-44b7e70e-9951-4280-b776-90f9b7064f6a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:31.582315 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-44b7e70e-9951-4280-b776-90f9b7064f6a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1266 microversion: 2.1 time: 0.152951 Jun 16 19:55:31.582874 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 643/1267] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:31 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:31.620870 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0da7e44c-1408-4f85-a29c-5196f23edd7f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:31.621479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0da7e44c-1408-4f85-a29c-5196f23edd7f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:31.628088 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0da7e44c-1408-4f85-a29c-5196f23edd7f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:31.628531 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0da7e44c-1408-4f85-a29c-5196f23edd7f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:31.629294 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0da7e44c-1408-4f85-a29c-5196f23edd7f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:31.629729 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0da7e44c-1408-4f85-a29c-5196f23edd7f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:31.699847 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0da7e44c-1408-4f85-a29c-5196f23edd7f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:31.707811 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0da7e44c-1408-4f85-a29c-5196f23edd7f tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 200 len: 1242 microversion: 2.1 time: 0.090845 Jun 16 19:55:31.708380 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 625/1268] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:31 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:32.599615 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6ffbd1c5-2124-482e-8eb7-0bee867765b6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:32.600224 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6ffbd1c5-2124-482e-8eb7-0bee867765b6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:32.606551 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6ffbd1c5-2124-482e-8eb7-0bee867765b6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:32.607590 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6ffbd1c5-2124-482e-8eb7-0bee867765b6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:32.608347 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6ffbd1c5-2124-482e-8eb7-0bee867765b6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:32.608777 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6ffbd1c5-2124-482e-8eb7-0bee867765b6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:32.725190 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c9787f2d-7acc-4f78-b802-be2b4a821e7c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:32.725795 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c9787f2d-7acc-4f78-b802-be2b4a821e7c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:32.732882 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c9787f2d-7acc-4f78-b802-be2b4a821e7c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:32.733392 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c9787f2d-7acc-4f78-b802-be2b4a821e7c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:32.734172 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c9787f2d-7acc-4f78-b802-be2b4a821e7c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:32.734604 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c9787f2d-7acc-4f78-b802-be2b4a821e7c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:32.741657 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6ffbd1c5-2124-482e-8eb7-0bee867765b6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:32.749197 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6ffbd1c5-2124-482e-8eb7-0bee867765b6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1266 microversion: 2.1 time: 0.153335 Jun 16 19:55:32.749773 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 644/1269] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:32 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:32.801310 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c9787f2d-7acc-4f78-b802-be2b4a821e7c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:32.808776 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c9787f2d-7acc-4f78-b802-be2b4a821e7c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 200 len: 1298 microversion: 2.1 time: 0.087393 Jun 16 19:55:32.809361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 626/1270] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:32 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:33.765794 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-cc7aa192-f7e0-46d1-acea-2d53a208f616 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:33.766420 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-cc7aa192-f7e0-46d1-acea-2d53a208f616 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:33.773128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cc7aa192-f7e0-46d1-acea-2d53a208f616 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:33.773576 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cc7aa192-f7e0-46d1-acea-2d53a208f616 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:33.774347 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cc7aa192-f7e0-46d1-acea-2d53a208f616 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:33.774784 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cc7aa192-f7e0-46d1-acea-2d53a208f616 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:33.826980 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ed1ada3b-bd0f-49b1-81b1-15ad742f5dfb tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:33.828298 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ed1ada3b-bd0f-49b1-81b1-15ad742f5dfb tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:33.835996 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed1ada3b-bd0f-49b1-81b1-15ad742f5dfb tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:33.836458 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed1ada3b-bd0f-49b1-81b1-15ad742f5dfb tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:33.837348 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed1ada3b-bd0f-49b1-81b1-15ad742f5dfb tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:33.837998 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed1ada3b-bd0f-49b1-81b1-15ad742f5dfb tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:33.912912 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-cc7aa192-f7e0-46d1-acea-2d53a208f616 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:33.921436 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-cc7aa192-f7e0-46d1-acea-2d53a208f616 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1266 microversion: 2.1 time: 0.159524 Jun 16 19:55:33.922013 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 645/1271] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:33 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:34.036150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ed1ada3b-bd0f-49b1-81b1-15ad742f5dfb tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:34.043614 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ed1ada3b-bd0f-49b1-81b1-15ad742f5dfb tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 200 len: 1364 microversion: 2.1 time: 0.220688 Jun 16 19:55:34.044175 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 627/1272] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:33 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:34.197810 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:55:34.198112 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Thu Jun 16 19:55:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:55:34.536964 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-20f99fa9-23f6-48ad-b502-6f667e12eb73 req-bfe5331c-6f63-4258-91cc-1798e0e5e1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45910442-549f-42cb-b2f6-33a53080f968", "tag": "33ca5360-3ec7-4901-bb9c-38ae7d1a35a8"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:55:34.547489 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-20f99fa9-23f6-48ad-b502-6f667e12eb73 req-bfe5331c-6f63-4258-91cc-1798e0e5e1c9 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:34.547717 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-20f99fa9-23f6-48ad-b502-6f667e12eb73 req-bfe5331c-6f63-4258-91cc-1798e0e5e1c9 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:34.561281 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-20f99fa9-23f6-48ad-b502-6f667e12eb73 req-bfe5331c-6f63-4258-91cc-1798e0e5e1c9 service nova] Creating event network-changed:33ca5360-3ec7-4901-bb9c-38ae7d1a35a8 for instance 45910442-549f-42cb-b2f6-33a53080f968 on hv-cinder-84617 Jun 16 19:55:34.566140 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-20f99fa9-23f6-48ad-b502-6f667e12eb73 req-bfe5331c-6f63-4258-91cc-1798e0e5e1c9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033196 Jun 16 19:55:34.567101 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 646/1273] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:55:34.937990 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1575e44c-3396-4094-b1fe-ad010f38b74b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:34.938631 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1575e44c-3396-4094-b1fe-ad010f38b74b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:34.945857 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1575e44c-3396-4094-b1fe-ad010f38b74b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:34.946304 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1575e44c-3396-4094-b1fe-ad010f38b74b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:34.947096 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1575e44c-3396-4094-b1fe-ad010f38b74b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:34.947536 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1575e44c-3396-4094-b1fe-ad010f38b74b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:35.063048 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b2f41f26-ede8-40d5-ac4f-e68a0ff0eafd tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:35.063048 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b2f41f26-ede8-40d5-ac4f-e68a0ff0eafd tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:35.069706 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b2f41f26-ede8-40d5-ac4f-e68a0ff0eafd tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:35.070183 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b2f41f26-ede8-40d5-ac4f-e68a0ff0eafd tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:35.070968 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b2f41f26-ede8-40d5-ac4f-e68a0ff0eafd tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:35.071411 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b2f41f26-ede8-40d5-ac4f-e68a0ff0eafd tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:35.074676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1575e44c-3396-4094-b1fe-ad010f38b74b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:35.082715 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1575e44c-3396-4094-b1fe-ad010f38b74b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1266 microversion: 2.1 time: 0.149050 Jun 16 19:55:35.083300 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 628/1274] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:34 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:35.199097 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b2f41f26-ede8-40d5-ac4f-e68a0ff0eafd tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:35.207361 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b2f41f26-ede8-40d5-ac4f-e68a0ff0eafd tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 200 len: 1364 microversion: 2.1 time: 0.150301 Jun 16 19:55:35.207918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 647/1275] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:35 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:36.098830 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-caf7bf48-1327-47e9-869b-784c14a861a1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:36.099483 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-caf7bf48-1327-47e9-869b-784c14a861a1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:36.105842 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-caf7bf48-1327-47e9-869b-784c14a861a1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:36.106298 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-caf7bf48-1327-47e9-869b-784c14a861a1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:36.107093 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-caf7bf48-1327-47e9-869b-784c14a861a1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:36.107527 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-caf7bf48-1327-47e9-869b-784c14a861a1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:36.223935 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-818809cf-14ce-44a2-9b5f-bb790c84195a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:36.224563 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-818809cf-14ce-44a2-9b5f-bb790c84195a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:36.230951 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-818809cf-14ce-44a2-9b5f-bb790c84195a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:36.231398 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-818809cf-14ce-44a2-9b5f-bb790c84195a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:36.232153 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-818809cf-14ce-44a2-9b5f-bb790c84195a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:36.232588 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-818809cf-14ce-44a2-9b5f-bb790c84195a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:36.236568 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-caf7bf48-1327-47e9-869b-784c14a861a1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:36.244128 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-caf7bf48-1327-47e9-869b-784c14a861a1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1266 microversion: 2.1 time: 0.149139 Jun 16 19:55:36.244716 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 629/1276] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:36 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:36.359733 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-818809cf-14ce-44a2-9b5f-bb790c84195a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:36.366983 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-818809cf-14ce-44a2-9b5f-bb790c84195a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 200 len: 1364 microversion: 2.1 time: 0.146868 Jun 16 19:55:36.367546 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 648/1277] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:36 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:37.260769 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c0a47e00-79ce-45d0-bc0b-454a3504c086 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:37.261374 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c0a47e00-79ce-45d0-bc0b-454a3504c086 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:37.267801 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c0a47e00-79ce-45d0-bc0b-454a3504c086 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:37.268251 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c0a47e00-79ce-45d0-bc0b-454a3504c086 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:37.268996 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c0a47e00-79ce-45d0-bc0b-454a3504c086 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:37.269427 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c0a47e00-79ce-45d0-bc0b-454a3504c086 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:37.384510 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0343d35d-13ec-40a6-8726-38e62f67513a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:37.385130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0343d35d-13ec-40a6-8726-38e62f67513a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:37.391627 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0343d35d-13ec-40a6-8726-38e62f67513a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:37.392079 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0343d35d-13ec-40a6-8726-38e62f67513a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:37.392851 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0343d35d-13ec-40a6-8726-38e62f67513a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:37.393287 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0343d35d-13ec-40a6-8726-38e62f67513a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:37.421640 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c0a47e00-79ce-45d0-bc0b-454a3504c086 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:37.429366 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c0a47e00-79ce-45d0-bc0b-454a3504c086 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1266 microversion: 2.1 time: 0.172396 Jun 16 19:55:37.429930 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 630/1278] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:37 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:37.536124 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0343d35d-13ec-40a6-8726-38e62f67513a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:37.543593 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0343d35d-13ec-40a6-8726-38e62f67513a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 200 len: 1364 microversion: 2.1 time: 0.163291 Jun 16 19:55:37.544150 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 649/1279] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:37 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:38.446375 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-84c1c955-2c2e-4aaa-a784-a9d0dcf17dc5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:38.446908 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-84c1c955-2c2e-4aaa-a784-a9d0dcf17dc5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:38.453415 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84c1c955-2c2e-4aaa-a784-a9d0dcf17dc5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:38.453862 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84c1c955-2c2e-4aaa-a784-a9d0dcf17dc5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:38.454619 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84c1c955-2c2e-4aaa-a784-a9d0dcf17dc5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:38.455086 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84c1c955-2c2e-4aaa-a784-a9d0dcf17dc5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:38.561508 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-1981ede5-e44b-4e8f-b9d6-a09841fe15e0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:38.562274 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-1981ede5-e44b-4e8f-b9d6-a09841fe15e0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:38.568909 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1981ede5-e44b-4e8f-b9d6-a09841fe15e0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:38.569348 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1981ede5-e44b-4e8f-b9d6-a09841fe15e0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:38.570111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1981ede5-e44b-4e8f-b9d6-a09841fe15e0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:38.570540 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-1981ede5-e44b-4e8f-b9d6-a09841fe15e0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:38.585333 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-84c1c955-2c2e-4aaa-a784-a9d0dcf17dc5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:38.588751 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:55:38.593633 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-84c1c955-2c2e-4aaa-a784-a9d0dcf17dc5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1266 microversion: 2.1 time: 0.151526 Jun 16 19:55:38.599873 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 631/1280] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:38 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:38.700021 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-1981ede5-e44b-4e8f-b9d6-a09841fe15e0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:38.707429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-1981ede5-e44b-4e8f-b9d6-a09841fe15e0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 200 len: 1364 microversion: 2.1 time: 0.150249 Jun 16 19:55:38.707997 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 650/1281] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:38 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:39.290731 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-59a0d659-f204-4b44-a5f3-ee614d525d4d req-d51f6385-b9d2-48e4-a4c6-9c1e5918e810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1", "name": "network-vif-plugged", "status": "completed", "tag": "26f4f314-2ae9-4591-86be-783a8b8117d6"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:55:39.298837 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-59a0d659-f204-4b44-a5f3-ee614d525d4d req-d51f6385-b9d2-48e4-a4c6-9c1e5918e810 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:39.299321 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-59a0d659-f204-4b44-a5f3-ee614d525d4d req-d51f6385-b9d2-48e4-a4c6-9c1e5918e810 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:39.310530 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-59a0d659-f204-4b44-a5f3-ee614d525d4d req-d51f6385-b9d2-48e4-a4c6-9c1e5918e810 service nova] Creating event network-vif-plugged:26f4f314-2ae9-4591-86be-783a8b8117d6 for instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 on hv-cinder-84617 Jun 16 19:55:39.315508 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-59a0d659-f204-4b44-a5f3-ee614d525d4d req-d51f6385-b9d2-48e4-a4c6-9c1e5918e810 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083133 Jun 16 19:55:39.316250 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 632/1282] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:55:39.609969 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-3617f145-5357-43b0-9521-d639009fce8b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:39.610565 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-3617f145-5357-43b0-9521-d639009fce8b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:39.612559 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=2 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:55:39.613349 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=18 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:55:39.618517 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3617f145-5357-43b0-9521-d639009fce8b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:39.618990 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3617f145-5357-43b0-9521-d639009fce8b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:39.619748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3617f145-5357-43b0-9521-d639009fce8b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:39.620181 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-3617f145-5357-43b0-9521-d639009fce8b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:39.722518 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=8 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:55:39.728699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cbd65b06-ee63-4b58-be04-7b49cf0ce9f0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:39.729686 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-cbd65b06-ee63-4b58-be04-7b49cf0ce9f0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:39.741375 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cbd65b06-ee63-4b58-be04-7b49cf0ce9f0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:39.742298 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cbd65b06-ee63-4b58-be04-7b49cf0ce9f0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:39.743881 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cbd65b06-ee63-4b58-be04-7b49cf0ce9f0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:39.746716 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cbd65b06-ee63-4b58-be04-7b49cf0ce9f0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:39.758356 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-3617f145-5357-43b0-9521-d639009fce8b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:39.766666 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-3617f145-5357-43b0-9521-d639009fce8b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1266 microversion: 2.1 time: 0.160545 Jun 16 19:55:39.767560 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 651/1283] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:39 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:39.897641 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cbd65b06-ee63-4b58-be04-7b49cf0ce9f0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:39.904967 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cbd65b06-ee63-4b58-be04-7b49cf0ce9f0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 200 len: 1364 microversion: 2.1 time: 0.183899 Jun 16 19:55:39.905516 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 633/1284] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:39 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:40.784735 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e29eb614-ae60-4d62-b3a0-91e0a943dd08 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:40.785341 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e29eb614-ae60-4d62-b3a0-91e0a943dd08 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:40.792365 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e29eb614-ae60-4d62-b3a0-91e0a943dd08 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:40.792810 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e29eb614-ae60-4d62-b3a0-91e0a943dd08 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:40.793557 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e29eb614-ae60-4d62-b3a0-91e0a943dd08 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:40.793987 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e29eb614-ae60-4d62-b3a0-91e0a943dd08 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:40.921617 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-be571e3e-07ff-42c5-ae3e-3c306de3a099 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:40.922356 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-be571e3e-07ff-42c5-ae3e-3c306de3a099 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:40.924817 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e29eb614-ae60-4d62-b3a0-91e0a943dd08 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:40.929521 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-be571e3e-07ff-42c5-ae3e-3c306de3a099 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:40.929978 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-be571e3e-07ff-42c5-ae3e-3c306de3a099 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:40.930778 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-be571e3e-07ff-42c5-ae3e-3c306de3a099 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:40.931455 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-be571e3e-07ff-42c5-ae3e-3c306de3a099 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:40.932386 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e29eb614-ae60-4d62-b3a0-91e0a943dd08 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1266 microversion: 2.1 time: 0.151929 Jun 16 19:55:40.932948 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 652/1285] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:40 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:41.062053 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-be571e3e-07ff-42c5-ae3e-3c306de3a099 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:41.069745 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-be571e3e-07ff-42c5-ae3e-3c306de3a099 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 200 len: 1364 microversion: 2.1 time: 0.151932 Jun 16 19:55:41.070316 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 634/1286] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:40 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:41.330497 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-e6e49a6f-1a94-444c-9d9f-b70eb2fa762e req-474bff79-0060-424b-9d4c-906951e1002e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45910442-549f-42cb-b2f6-33a53080f968", "name": "network-vif-plugged", "status": "completed", "tag": "33ca5360-3ec7-4901-bb9c-38ae7d1a35a8"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:55:41.339366 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-e6e49a6f-1a94-444c-9d9f-b70eb2fa762e req-474bff79-0060-424b-9d4c-906951e1002e service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:41.339810 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-e6e49a6f-1a94-444c-9d9f-b70eb2fa762e req-474bff79-0060-424b-9d4c-906951e1002e service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:41.343417 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=100 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:55:41.350656 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-e6e49a6f-1a94-444c-9d9f-b70eb2fa762e req-474bff79-0060-424b-9d4c-906951e1002e service nova] Creating event network-vif-plugged:33ca5360-3ec7-4901-bb9c-38ae7d1a35a8 for instance 45910442-549f-42cb-b2f6-33a53080f968 on hv-cinder-84617 Jun 16 19:55:41.355732 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-e6e49a6f-1a94-444c-9d9f-b70eb2fa762e req-474bff79-0060-424b-9d4c-906951e1002e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028923 Jun 16 19:55:41.360084 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 653/1287] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:55:41.949939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-dc54b49f-c389-4b98-a58c-190a62b94d59 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:41.950479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-dc54b49f-c389-4b98-a58c-190a62b94d59 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:41.957373 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc54b49f-c389-4b98-a58c-190a62b94d59 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:41.957821 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc54b49f-c389-4b98-a58c-190a62b94d59 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:41.958576 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc54b49f-c389-4b98-a58c-190a62b94d59 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:41.959313 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dc54b49f-c389-4b98-a58c-190a62b94d59 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:42.085676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-dc54b49f-c389-4b98-a58c-190a62b94d59 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:42.088260 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-82cbcf0c-7798-43ca-b76f-f7e626180066 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:42.088960 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-82cbcf0c-7798-43ca-b76f-f7e626180066 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:42.093732 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-dc54b49f-c389-4b98-a58c-190a62b94d59 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1453 microversion: 2.1 time: 0.147696 Jun 16 19:55:42.094289 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 635/1288] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:41 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:55:42.096291 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-82cbcf0c-7798-43ca-b76f-f7e626180066 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:42.096761 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-82cbcf0c-7798-43ca-b76f-f7e626180066 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:42.097811 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-82cbcf0c-7798-43ca-b76f-f7e626180066 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:42.098289 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-82cbcf0c-7798-43ca-b76f-f7e626180066 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:42.109766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-552bca59-193b-40f8-a00c-c63928cf38d9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:42.110463 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-552bca59-193b-40f8-a00c-c63928cf38d9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:42.116851 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-552bca59-193b-40f8-a00c-c63928cf38d9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:42.117377 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-552bca59-193b-40f8-a00c-c63928cf38d9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:42.118204 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-552bca59-193b-40f8-a00c-c63928cf38d9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:42.118710 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-552bca59-193b-40f8-a00c-c63928cf38d9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:42.229784 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-82cbcf0c-7798-43ca-b76f-f7e626180066 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:42.237419 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-82cbcf0c-7798-43ca-b76f-f7e626180066 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 200 len: 1364 microversion: 2.1 time: 0.154098 Jun 16 19:55:42.238017 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 654/1289] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:42 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:42.252519 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-552bca59-193b-40f8-a00c-c63928cf38d9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:42.259891 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-552bca59-193b-40f8-a00c-c63928cf38d9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1453 microversion: 2.1 time: 0.154057 Jun 16 19:55:42.260450 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 636/1290] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:42 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:43.254208 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-07f93e5d-79e1-47a9-8113-912416d4319d tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:43.254889 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-07f93e5d-79e1-47a9-8113-912416d4319d tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:43.265271 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-07f93e5d-79e1-47a9-8113-912416d4319d tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:43.265715 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-07f93e5d-79e1-47a9-8113-912416d4319d tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:43.266476 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-07f93e5d-79e1-47a9-8113-912416d4319d tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:43.266908 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-07f93e5d-79e1-47a9-8113-912416d4319d tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:43.394141 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-07f93e5d-79e1-47a9-8113-912416d4319d tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:43.401792 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-07f93e5d-79e1-47a9-8113-912416d4319d tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 200 len: 1364 microversion: 2.1 time: 0.151538 Jun 16 19:55:43.402360 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 655/1291] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:43 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:44.317160 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-f2dd8eef-a5d4-435c-90d7-257dbc8962c0 req-e860a34d-14af-4d2a-b6e3-b76eec2eb152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1", "tag": "26f4f314-2ae9-4591-86be-783a8b8117d6"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:55:44.325980 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-f2dd8eef-a5d4-435c-90d7-257dbc8962c0 req-e860a34d-14af-4d2a-b6e3-b76eec2eb152 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:44.326430 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-f2dd8eef-a5d4-435c-90d7-257dbc8962c0 req-e860a34d-14af-4d2a-b6e3-b76eec2eb152 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:44.337511 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-f2dd8eef-a5d4-435c-90d7-257dbc8962c0 req-e860a34d-14af-4d2a-b6e3-b76eec2eb152 service nova] Creating event network-changed:26f4f314-2ae9-4591-86be-783a8b8117d6 for instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 on hv-cinder-84617 Jun 16 19:55:44.342497 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-f2dd8eef-a5d4-435c-90d7-257dbc8962c0 req-e860a34d-14af-4d2a-b6e3-b76eec2eb152 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029104 Jun 16 19:55:44.343430 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 637/1292] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:55:44.420143 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-75604c00-97a2-48c3-8a6d-4869d1a0f951 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:44.420681 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-75604c00-97a2-48c3-8a6d-4869d1a0f951 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:44.427269 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-75604c00-97a2-48c3-8a6d-4869d1a0f951 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:44.427721 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-75604c00-97a2-48c3-8a6d-4869d1a0f951 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:44.428480 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-75604c00-97a2-48c3-8a6d-4869d1a0f951 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:44.429106 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-75604c00-97a2-48c3-8a6d-4869d1a0f951 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:44.568899 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-75604c00-97a2-48c3-8a6d-4869d1a0f951 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:55:44.577207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-75604c00-97a2-48c3-8a6d-4869d1a0f951 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 200 len: 1549 microversion: 2.1 time: 0.161482 Jun 16 19:55:44.578960 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 656/1293] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:55:44 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:55:44.594466 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fd827fab-b18e-4e00-af08-debe592235d7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:55:44.595145 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fd827fab-b18e-4e00-af08-debe592235d7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:55:44.601313 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd827fab-b18e-4e00-af08-debe592235d7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:44.601957 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd827fab-b18e-4e00-af08-debe592235d7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:44.603037 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd827fab-b18e-4e00-af08-debe592235d7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:44.603644 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd827fab-b18e-4e00-af08-debe592235d7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:44.713171 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fd827fab-b18e-4e00-af08-debe592235d7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123138 Jun 16 19:55:44.713759 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 638/1294] 10.222.0.36 () {58 vars in 1274 bytes} [Thu Jun 16 19:55:44 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:55:46.426436 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-4ffc58db-3469-47f8-bbb9-cf6999d76945 req-dc07ea9d-6549-46c1-9f3e-e3d808811cef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45910442-549f-42cb-b2f6-33a53080f968", "tag": "33ca5360-3ec7-4901-bb9c-38ae7d1a35a8"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:55:46.431619 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:55:46.436011 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-4ffc58db-3469-47f8-bbb9-cf6999d76945 req-dc07ea9d-6549-46c1-9f3e-e3d808811cef service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:55:46.437151 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-4ffc58db-3469-47f8-bbb9-cf6999d76945 req-dc07ea9d-6549-46c1-9f3e-e3d808811cef service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:55:46.448721 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-4ffc58db-3469-47f8-bbb9-cf6999d76945 req-dc07ea9d-6549-46c1-9f3e-e3d808811cef service nova] Creating event network-changed:33ca5360-3ec7-4901-bb9c-38ae7d1a35a8 for instance 45910442-549f-42cb-b2f6-33a53080f968 on hv-cinder-84617 Jun 16 19:55:46.454300 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-4ffc58db-3469-47f8-bbb9-cf6999d76945 req-dc07ea9d-6549-46c1-9f3e-e3d808811cef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031472 Jun 16 19:55:46.454894 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 657/1295] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:56:21.413557 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:56:21.414319 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=32 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:56:21.418231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e2448ad2-d007-461f-9c3b-fbd18a6f9633 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:21.418659 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e2448ad2-d007-461f-9c3b-fbd18a6f9633 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:21.424969 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e2448ad2-d007-461f-9c3b-fbd18a6f9633 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:21.425408 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e2448ad2-d007-461f-9c3b-fbd18a6f9633 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:21.426190 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e2448ad2-d007-461f-9c3b-fbd18a6f9633 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:21.426625 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e2448ad2-d007-461f-9c3b-fbd18a6f9633 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:21.449279 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e2448ad2-d007-461f-9c3b-fbd18a6f9633 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/ips" status: 200 len: 144 microversion: 2.1 time: 0.037288 Jun 16 19:56:21.449829 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 639/1296] 10.222.0.36 () {58 vars in 1247 bytes} [Thu Jun 16 19:56:21 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:56:23.154134 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=20 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:56:23.158638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d8875ae0-d2b5-49a0-b13e-4209e53d7970 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4634ee67-bbd6-464b-951f-cff422cf8f6f"}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:56:23.159854 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d8875ae0-d2b5-49a0-b13e-4209e53d7970 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:23.166543 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d8875ae0-d2b5-49a0-b13e-4209e53d7970 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:23.167029 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d8875ae0-d2b5-49a0-b13e-4209e53d7970 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:23.167808 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d8875ae0-d2b5-49a0-b13e-4209e53d7970 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:23.168239 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d8875ae0-d2b5-49a0-b13e-4209e53d7970 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:24.035215 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d8875ae0-d2b5-49a0-b13e-4209e53d7970 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "POST /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.882414 Jun 16 19:56:24.035946 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 658/1297] 10.222.0.36 () {60 vars in 1322 bytes} [Thu Jun 16 19:56:23 2022] POST /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments => generated 194 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:56:31.527265 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-78de82ab-11cb-4db0-ab94-4aba70e2b42b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:31.542588 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-78de82ab-11cb-4db0-ab94-4aba70e2b42b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:31.542588 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-78de82ab-11cb-4db0-ab94-4aba70e2b42b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:31.542588 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-78de82ab-11cb-4db0-ab94-4aba70e2b42b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:31.542588 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-78de82ab-11cb-4db0-ab94-4aba70e2b42b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:31.543039 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-78de82ab-11cb-4db0-ab94-4aba70e2b42b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:31.569675 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-78de82ab-11cb-4db0-ab94-4aba70e2b42b tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046662 Jun 16 19:56:31.571442 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 640/1298] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:56:31 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:56:31.581393 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d3385765-fad9-4731-9e6e-18c8d1d71fee tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:31.581980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d3385765-fad9-4731-9e6e-18c8d1d71fee tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:31.588257 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d3385765-fad9-4731-9e6e-18c8d1d71fee tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:31.588710 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d3385765-fad9-4731-9e6e-18c8d1d71fee tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:31.589477 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d3385765-fad9-4731-9e6e-18c8d1d71fee tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:31.589916 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d3385765-fad9-4731-9e6e-18c8d1d71fee tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:31.618366 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d3385765-fad9-4731-9e6e-18c8d1d71fee tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments/4634ee67-bbd6-464b-951f-cff422cf8f6f" status: 200 len: 194 microversion: 2.1 time: 0.041729 Jun 16 19:56:31.634227 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 659/1299] 10.222.0.36 () {58 vars in 1412 bytes} [Thu Jun 16 19:56:31 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments/4634ee67-bbd6-464b-951f-cff422cf8f6f => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:56:33.295453 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fa28e3ba-3dd9-4461-8cdf-4c1d9def73e8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b85212f3-f9cf-40c5-9d2f-fda8f8c57ef4"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:56:33.296495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fa28e3ba-3dd9-4461-8cdf-4c1d9def73e8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:33.304360 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa28e3ba-3dd9-4461-8cdf-4c1d9def73e8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:33.304830 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa28e3ba-3dd9-4461-8cdf-4c1d9def73e8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:33.305680 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa28e3ba-3dd9-4461-8cdf-4c1d9def73e8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:33.306114 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa28e3ba-3dd9-4461-8cdf-4c1d9def73e8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:34.326034 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fa28e3ba-3dd9-4461-8cdf-4c1d9def73e8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "POST /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.034210 Jun 16 19:56:34.326716 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 641/1300] 10.222.0.36 () {60 vars in 1322 bytes} [Thu Jun 16 19:56:33 2022] POST /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments => generated 194 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:56:42.879558 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5694ffb1-1415-4b65-99f8-2be7706bd8d2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:42.880571 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5694ffb1-1415-4b65-99f8-2be7706bd8d2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:42.883138 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=4 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:56:42.883805 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:56:42.888530 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5694ffb1-1415-4b65-99f8-2be7706bd8d2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:42.888979 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5694ffb1-1415-4b65-99f8-2be7706bd8d2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:42.889734 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5694ffb1-1415-4b65-99f8-2be7706bd8d2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:42.890170 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5694ffb1-1415-4b65-99f8-2be7706bd8d2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:42.919518 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5694ffb1-1415-4b65-99f8-2be7706bd8d2 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043865 Jun 16 19:56:42.920067 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 660/1301] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:56:42 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:56:43.082351 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ad69ea5c-286f-4876-b2e5-227688955ebf tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:43.082876 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ad69ea5c-286f-4876-b2e5-227688955ebf tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:43.089108 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad69ea5c-286f-4876-b2e5-227688955ebf tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:43.089567 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad69ea5c-286f-4876-b2e5-227688955ebf tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:43.090326 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad69ea5c-286f-4876-b2e5-227688955ebf tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:43.090759 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad69ea5c-286f-4876-b2e5-227688955ebf tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:43.118894 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ad69ea5c-286f-4876-b2e5-227688955ebf tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments/4634ee67-bbd6-464b-951f-cff422cf8f6f" status: 200 len: 194 microversion: 2.1 time: 0.042077 Jun 16 19:56:43.119502 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 642/1302] 10.222.0.36 () {58 vars in 1412 bytes} [Thu Jun 16 19:56:43 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments/4634ee67-bbd6-464b-951f-cff422cf8f6f => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:56:43.128984 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8e3aca02-7d91-44b3-be3c-4054c4bbe500 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:43.129476 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8e3aca02-7d91-44b3-be3c-4054c4bbe500 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:43.136476 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8e3aca02-7d91-44b3-be3c-4054c4bbe500 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:43.136924 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8e3aca02-7d91-44b3-be3c-4054c4bbe500 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:43.137679 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8e3aca02-7d91-44b3-be3c-4054c4bbe500 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:43.142649 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8e3aca02-7d91-44b3-be3c-4054c4bbe500 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:43.217854 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-8e3aca02-7d91-44b3-be3c-4054c4bbe500 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lazy-loading 'services' on Instance uuid 45910442-549f-42cb-b2f6-33a53080f968 {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:56:43.487409 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8e3aca02-7d91-44b3-be3c-4054c4bbe500 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "DELETE /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments/4634ee67-bbd6-464b-951f-cff422cf8f6f" status: 202 len: 0 microversion: 2.1 time: 0.362090 Jun 16 19:56:43.487990 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 661/1303] 10.222.0.36 () {58 vars in 1415 bytes} [Thu Jun 16 19:56:43 2022] DELETE /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments/4634ee67-bbd6-464b-951f-cff422cf8f6f => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:56:45.651890 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c0604179-0cfb-4355-bd00-2c84ab5bb71a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:45.652419 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c0604179-0cfb-4355-bd00-2c84ab5bb71a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:45.658792 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c0604179-0cfb-4355-bd00-2c84ab5bb71a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:45.659275 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c0604179-0cfb-4355-bd00-2c84ab5bb71a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:45.660033 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c0604179-0cfb-4355-bd00-2c84ab5bb71a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:45.660470 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c0604179-0cfb-4355-bd00-2c84ab5bb71a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:45.688718 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c0604179-0cfb-4355-bd00-2c84ab5bb71a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments/b85212f3-f9cf-40c5-9d2f-fda8f8c57ef4" status: 200 len: 194 microversion: 2.1 time: 0.041065 Jun 16 19:56:45.689497 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 643/1304] 10.222.0.36 () {58 vars in 1412 bytes} [Thu Jun 16 19:56:45 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments/b85212f3-f9cf-40c5-9d2f-fda8f8c57ef4 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:56:45.707670 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bb9f22b3-56ce-4641-8931-4cdbc20165c1 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:45.708799 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-bb9f22b3-56ce-4641-8931-4cdbc20165c1 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:45.714986 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bb9f22b3-56ce-4641-8931-4cdbc20165c1 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:45.715457 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bb9f22b3-56ce-4641-8931-4cdbc20165c1 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:45.716242 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bb9f22b3-56ce-4641-8931-4cdbc20165c1 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:45.716682 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bb9f22b3-56ce-4641-8931-4cdbc20165c1 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:45.795881 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-bb9f22b3-56ce-4641-8931-4cdbc20165c1 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lazy-loading 'services' on Instance uuid 45910442-549f-42cb-b2f6-33a53080f968 {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:56:46.007877 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-bb9f22b3-56ce-4641-8931-4cdbc20165c1 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "DELETE /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments/b85212f3-f9cf-40c5-9d2f-fda8f8c57ef4" status: 202 len: 0 microversion: 2.1 time: 0.304820 Jun 16 19:56:46.008471 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 662/1305] 10.222.0.36 () {58 vars in 1415 bytes} [Thu Jun 16 19:56:45 2022] DELETE /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments/b85212f3-f9cf-40c5-9d2f-fda8f8c57ef4 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:56:48.216407 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f727ed2d-eb36-4df2-911d-9bc89ad2007e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:48.217423 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f727ed2d-eb36-4df2-911d-9bc89ad2007e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:48.224028 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f727ed2d-eb36-4df2-911d-9bc89ad2007e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:48.224483 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f727ed2d-eb36-4df2-911d-9bc89ad2007e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:48.225246 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f727ed2d-eb36-4df2-911d-9bc89ad2007e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:48.225682 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f727ed2d-eb36-4df2-911d-9bc89ad2007e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:48.253528 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f727ed2d-eb36-4df2-911d-9bc89ad2007e tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041049 Jun 16 19:56:48.254064 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 644/1306] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:56:48 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:56:48.356870 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-f218d1b1-cb9c-4845-bc05-c1d0f8239e32 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:48.357870 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-f218d1b1-cb9c-4845-bc05-c1d0f8239e32 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:48.363953 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f218d1b1-cb9c-4845-bc05-c1d0f8239e32 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:48.364402 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f218d1b1-cb9c-4845-bc05-c1d0f8239e32 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:48.365150 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f218d1b1-cb9c-4845-bc05-c1d0f8239e32 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:48.365575 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-f218d1b1-cb9c-4845-bc05-c1d0f8239e32 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:48.393293 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-f218d1b1-cb9c-4845-bc05-c1d0f8239e32 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041012 Jun 16 19:56:48.393788 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 663/1307] 10.222.0.36 () {58 vars in 1301 bytes} [Thu Jun 16 19:56:48 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:56:48.459315 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-92184d92-d8af-421f-813f-5b54c074339a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:48.459817 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-92184d92-d8af-421f-813f-5b54c074339a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:48.465816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92184d92-d8af-421f-813f-5b54c074339a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:48.466267 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92184d92-d8af-421f-813f-5b54c074339a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:48.467124 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92184d92-d8af-421f-813f-5b54c074339a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:48.467569 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92184d92-d8af-421f-813f-5b54c074339a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:48.493390 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-92184d92-d8af-421f-813f-5b54c074339a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Going to try to terminate instance {{(pid=124550) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:56:48.853671 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-92184d92-d8af-421f-813f-5b54c074339a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "DELETE /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 204 len: 0 microversion: 2.1 time: 0.398500 Jun 16 19:56:48.854253 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 645/1308] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:56:48 2022] DELETE /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:56:48.862401 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b826fb98-926b-42f5-8ee0-d42abeb9496a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:48.863020 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b826fb98-926b-42f5-8ee0-d42abeb9496a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:48.868995 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b826fb98-926b-42f5-8ee0-d42abeb9496a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:48.869439 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b826fb98-926b-42f5-8ee0-d42abeb9496a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:48.870193 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b826fb98-926b-42f5-8ee0-d42abeb9496a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:48.870622 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b826fb98-926b-42f5-8ee0-d42abeb9496a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:49.006000 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b826fb98-926b-42f5-8ee0-d42abeb9496a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:56:49.013524 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b826fb98-926b-42f5-8ee0-d42abeb9496a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 200 len: 1673 microversion: 2.1 time: 0.154951 Jun 16 19:56:49.014084 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 664/1309] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:56:48 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:56:50.034140 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-536bfed1-f161-405b-98bc-9d3e5ebbd677 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:50.034833 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-536bfed1-f161-405b-98bc-9d3e5ebbd677 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:50.041586 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-536bfed1-f161-405b-98bc-9d3e5ebbd677 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:50.042031 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-536bfed1-f161-405b-98bc-9d3e5ebbd677 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:50.042794 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-536bfed1-f161-405b-98bc-9d3e5ebbd677 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:50.043251 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-536bfed1-f161-405b-98bc-9d3e5ebbd677 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:50.175406 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-536bfed1-f161-405b-98bc-9d3e5ebbd677 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:56:50.183065 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-536bfed1-f161-405b-98bc-9d3e5ebbd677 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 200 len: 1673 microversion: 2.1 time: 0.153157 Jun 16 19:56:50.183633 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 646/1310] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:56:50 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:56:51.201003 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-cc96329e-f074-4a10-9d9f-4f45124ef312 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:51.203933 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-cc96329e-f074-4a10-9d9f-4f45124ef312 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:51.208362 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cc96329e-f074-4a10-9d9f-4f45124ef312 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:51.208819 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cc96329e-f074-4a10-9d9f-4f45124ef312 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:51.209653 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cc96329e-f074-4a10-9d9f-4f45124ef312 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:51.210040 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-cc96329e-f074-4a10-9d9f-4f45124ef312 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:51.343607 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-cc96329e-f074-4a10-9d9f-4f45124ef312 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:56:51.351666 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-cc96329e-f074-4a10-9d9f-4f45124ef312 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 200 len: 1673 microversion: 2.1 time: 0.154734 Jun 16 19:56:51.352222 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 665/1311] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:56:51 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:56:51.807064 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-b8212a9d-acc5-4f33-a757-4aa25d76fa91 req-634927aa-dda5-405c-994e-05d4c7458e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45910442-549f-42cb-b2f6-33a53080f968", "name": "network-vif-deleted", "tag": "33ca5360-3ec7-4901-bb9c-38ae7d1a35a8"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:56:51.816830 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-b8212a9d-acc5-4f33-a757-4aa25d76fa91 req-634927aa-dda5-405c-994e-05d4c7458e7a service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:51.816830 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-b8212a9d-acc5-4f33-a757-4aa25d76fa91 req-634927aa-dda5-405c-994e-05d4c7458e7a service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:51.827611 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-b8212a9d-acc5-4f33-a757-4aa25d76fa91 req-634927aa-dda5-405c-994e-05d4c7458e7a service nova] Creating event network-vif-deleted:33ca5360-3ec7-4901-bb9c-38ae7d1a35a8 for instance 45910442-549f-42cb-b2f6-33a53080f968 on hv-cinder-84617 Jun 16 19:56:51.832731 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-b8212a9d-acc5-4f33-a757-4aa25d76fa91 req-634927aa-dda5-405c-994e-05d4c7458e7a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029325 Jun 16 19:56:51.834069 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 647/1312] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:56:52.369353 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5e0ee1a7-5942-484c-ba9c-7dc0324d39f0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:52.369895 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5e0ee1a7-5942-484c-ba9c-7dc0324d39f0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:52.376421 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5e0ee1a7-5942-484c-ba9c-7dc0324d39f0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:52.376872 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5e0ee1a7-5942-484c-ba9c-7dc0324d39f0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:52.377756 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5e0ee1a7-5942-484c-ba9c-7dc0324d39f0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:52.378223 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5e0ee1a7-5942-484c-ba9c-7dc0324d39f0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:52.409435 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5e0ee1a7-5942-484c-ba9c-7dc0324d39f0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:52.409884 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5e0ee1a7-5942-484c-ba9c-7dc0324d39f0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:52.410423 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-5e0ee1a7-5942-484c-ba9c-7dc0324d39f0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lazy-loading 'fault' on Instance uuid 45910442-549f-42cb-b2f6-33a53080f968 {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:56:52.451721 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5e0ee1a7-5942-484c-ba9c-7dc0324d39f0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0251939fa06a45da898a12a37ac91163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caa2a2f7c644b16a76b9dff92a2b2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:56:52.459884 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5e0ee1a7-5942-484c-ba9c-7dc0324d39f0 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 200 len: 1328 microversion: 2.1 time: 0.094614 Jun 16 19:56:52.460467 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 666/1313] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:56:52 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 1328 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:56:53.478031 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-86987ea7-c904-4198-9d1a-7779b14b088a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:53.478833 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-86987ea7-c904-4198-9d1a-7779b14b088a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:53.486173 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86987ea7-c904-4198-9d1a-7779b14b088a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:53.486621 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86987ea7-c904-4198-9d1a-7779b14b088a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:53.487443 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86987ea7-c904-4198-9d1a-7779b14b088a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:53.487876 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86987ea7-c904-4198-9d1a-7779b14b088a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:53.500825 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-86987ea7-c904-4198-9d1a-7779b14b088a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] HTTP exception thrown: Instance 45910442-549f-42cb-b2f6-33a53080f968 could not be found. Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-86987ea7-c904-4198-9d1a-7779b14b088a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Request method failure captured: Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 HTTP/1.1 Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4n71jdLLlXCyYOPPKqI7T6Cdy-LbAhN31Iw20cgKuY4Ry-3m1V4Pwfdm75FIQbFO5ZuJ-O4GBFbOPX-BZG7U9iM-m1DjpPcdR-Tax9Y17Yq9i3ptRxg6fPm3kFdQhFUFX3gr3NZR3NwBVBrOPLK5AgDwY3kHf5KCAEiLPVQkdMccD4 Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 7caa2a2f7c644b16a76b9dff92a2b2e8 Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeTestJSON-112593294 Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:56:53.502459 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:56:53.504262 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7caa2a2f7c644b16a76b9dff92a2b2e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7caa2a2f7c644b16a76b9dff92a2b2e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7caa2a2f7c644b16a76b9dff92a2b2e8", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7caa2a2f7c644b16a76b9dff92a2b2e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:56:53.504262 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeTestJSON-112593294 Jun 16 19:56:53.504262 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 7caa2a2f7c644b16a76b9dff92a2b2e8 Jun 16 19:56:53.504262 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeTestJSON-112593294 Jun 16 19:56:53.504262 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeTestJSON-112593294-project Jun 16 19:56:53.504262 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:56:53.504262 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:56:53.504262 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 0251939fa06a45da898a12a37ac91163 Jun 16 19:56:53.504262 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeTestJSON-112593294-project Jun 16 19:56:53.504262 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:56:53.504262 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance 45910442-549f-42cb-b2f6-33a53080f968 could not be found. Jun 16 19:56:53.504262 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': '45910442-549f-42cb-b2f6-33a53080f968'} Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45910442-549f-42cb-b2f6-33a53080f968 could not be found. Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:56:53.505229 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:56:53.506826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:56:53.506826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:56:53.506826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:56:53.506826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:56:53.506826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:56:53.506826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:56:53.506826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:56:53.506826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45910442-549f-42cb-b2f6-33a53080f968 could not be found. Jun 16 19:56:53.506826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:56:53.506826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:56:53.506826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:56:53.506826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:56:53.506826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:56:53.506826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:56:53.506826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:56:53.506826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:56:53.506826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45910442-549f-42cb-b2f6-33a53080f968 could not be found. Jun 16 19:56:53.506826 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:56:53.508251 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-86987ea7-c904-4198-9d1a-7779b14b088a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Returning 404 to user: Instance 45910442-549f-42cb-b2f6-33a53080f968 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:56:53.508251 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-86987ea7-c904-4198-9d1a-7779b14b088a tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 404 len: 111 microversion: 2.1 time: 0.030093 Jun 16 19:56:53.508251 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 648/1314] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:56:53 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:56:53.512730 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b785cba8-7c0a-49cf-a728-d306d788f4d7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '.version_select at 0x7f0505cc68b0>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:53.620624 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b785cba8-7c0a-49cf-a728-d306d788f4d7 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1668126497" status: 202 len: 0 microversion: 2.1 time: 0.111637 Jun 16 19:56:53.621207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 667/1315] 10.222.0.36 () {58 vars in 1220 bytes} [Thu Jun 16 19:56:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1668126497 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:56:57.004094 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-806db7b3-182c-4d0d-83e0-5c0b557fce3c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:57.004609 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-806db7b3-182c-4d0d-83e0-5c0b557fce3c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:57.011655 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-806db7b3-182c-4d0d-83e0-5c0b557fce3c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:57.012100 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-806db7b3-182c-4d0d-83e0-5c0b557fce3c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:57.012848 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-806db7b3-182c-4d0d-83e0-5c0b557fce3c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:57.013281 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-806db7b3-182c-4d0d-83e0-5c0b557fce3c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:57.028120 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-806db7b3-182c-4d0d-83e0-5c0b557fce3c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] HTTP exception thrown: Instance 45910442-549f-42cb-b2f6-33a53080f968 could not be found. Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-806db7b3-182c-4d0d-83e0-5c0b557fce3c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Request method failure captured: Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: DELETE /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 HTTP/1.1 Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4n71jdLLlXCyYOPPKqI7T6Cdy-LbAhN31Iw20cgKuY4Ry-3m1V4Pwfdm75FIQbFO5ZuJ-O4GBFbOPX-BZG7U9iM-m1DjpPcdR-Tax9Y17Yq9i3ptRxg6fPm3kFdQhFUFX3gr3NZR3NwBVBrOPLK5AgDwY3kHf5KCAEiLPVQkdMccD4 Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 7caa2a2f7c644b16a76b9dff92a2b2e8 Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeTestJSON-112593294 Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:56:57.029719 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:56:57.031478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7caa2a2f7c644b16a76b9dff92a2b2e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7caa2a2f7c644b16a76b9dff92a2b2e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7caa2a2f7c644b16a76b9dff92a2b2e8", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7caa2a2f7c644b16a76b9dff92a2b2e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:56:57.031478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeTestJSON-112593294 Jun 16 19:56:57.031478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 7caa2a2f7c644b16a76b9dff92a2b2e8 Jun 16 19:56:57.031478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeTestJSON-112593294 Jun 16 19:56:57.031478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeTestJSON-112593294-project Jun 16 19:56:57.031478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:56:57.031478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:56:57.031478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 0251939fa06a45da898a12a37ac91163 Jun 16 19:56:57.031478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeTestJSON-112593294-project Jun 16 19:56:57.031478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:56:57.031478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance 45910442-549f-42cb-b2f6-33a53080f968 could not be found. Jun 16 19:56:57.031478 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': '45910442-549f-42cb-b2f6-33a53080f968'} Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45910442-549f-42cb-b2f6-33a53080f968 could not be found. Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:56:57.032461 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45910442-549f-42cb-b2f6-33a53080f968 could not be found. Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45910442-549f-42cb-b2f6-33a53080f968 could not be found. Jun 16 19:56:57.033853 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:56:57.035477 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-806db7b3-182c-4d0d-83e0-5c0b557fce3c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Returning 404 to user: Instance 45910442-549f-42cb-b2f6-33a53080f968 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:56:57.035477 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-806db7b3-182c-4d0d-83e0-5c0b557fce3c tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "DELETE /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 404 len: 111 microversion: 2.1 time: 0.031136 Jun 16 19:56:57.035477 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 649/1316] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:56:56 2022] DELETE /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:56:57.040802 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-104194e8-840a-4dc0-909c-3211eaa281ea tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:57.041416 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-104194e8-840a-4dc0-909c-3211eaa281ea tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 45910442-549f-42cb-b2f6-33a53080f968] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:57.048227 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-104194e8-840a-4dc0-909c-3211eaa281ea tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:57.048685 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-104194e8-840a-4dc0-909c-3211eaa281ea tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:57.049458 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-104194e8-840a-4dc0-909c-3211eaa281ea tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:57.049902 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-104194e8-840a-4dc0-909c-3211eaa281ea tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:57.063366 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-104194e8-840a-4dc0-909c-3211eaa281ea tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] HTTP exception thrown: Instance 45910442-549f-42cb-b2f6-33a53080f968 could not be found. Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-104194e8-840a-4dc0-909c-3211eaa281ea tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Request method failure captured: Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 HTTP/1.1 Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4n71jdLLlXCyYOPPKqI7T6Cdy-LbAhN31Iw20cgKuY4Ry-3m1V4Pwfdm75FIQbFO5ZuJ-O4GBFbOPX-BZG7U9iM-m1DjpPcdR-Tax9Y17Yq9i3ptRxg6fPm3kFdQhFUFX3gr3NZR3NwBVBrOPLK5AgDwY3kHf5KCAEiLPVQkdMccD4 Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 7caa2a2f7c644b16a76b9dff92a2b2e8 Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-AttachVolumeTestJSON-112593294 Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:56:57.065001 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:56:57.066748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7caa2a2f7c644b16a76b9dff92a2b2e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7caa2a2f7c644b16a76b9dff92a2b2e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7caa2a2f7c644b16a76b9dff92a2b2e8", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7caa2a2f7c644b16a76b9dff92a2b2e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:56:57.066748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-AttachVolumeTestJSON-112593294 Jun 16 19:56:57.066748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 7caa2a2f7c644b16a76b9dff92a2b2e8 Jun 16 19:56:57.066748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-AttachVolumeTestJSON-112593294 Jun 16 19:56:57.066748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-AttachVolumeTestJSON-112593294-project Jun 16 19:56:57.066748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:56:57.066748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:56:57.066748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 0251939fa06a45da898a12a37ac91163 Jun 16 19:56:57.066748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-AttachVolumeTestJSON-112593294-project Jun 16 19:56:57.066748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:56:57.066748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance 45910442-549f-42cb-b2f6-33a53080f968 could not be found. Jun 16 19:56:57.066748 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': '45910442-549f-42cb-b2f6-33a53080f968'} Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45910442-549f-42cb-b2f6-33a53080f968 could not be found. Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:56:57.068434 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:56:57.069957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:56:57.069957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:56:57.069957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:56:57.069957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:56:57.069957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:56:57.069957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:56:57.069957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:56:57.069957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45910442-549f-42cb-b2f6-33a53080f968 could not be found. Jun 16 19:56:57.069957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:56:57.069957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:56:57.069957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:56:57.069957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:56:57.069957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:56:57.069957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:56:57.069957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:56:57.069957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:56:57.069957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45910442-549f-42cb-b2f6-33a53080f968 could not be found. Jun 16 19:56:57.069957 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:56:57.071567 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-104194e8-840a-4dc0-909c-3211eaa281ea tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Returning 404 to user: Instance 45910442-549f-42cb-b2f6-33a53080f968 could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:56:57.071567 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-104194e8-840a-4dc0-909c-3211eaa281ea tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968" status: 404 len: 111 microversion: 2.1 time: 0.029898 Jun 16 19:56:57.071567 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 668/1317] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:56:57 2022] GET /compute/v2.1/servers/45910442-549f-42cb-b2f6-33a53080f968 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:56:58.469314 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-337cdbd4-8a03-4ffb-9477-96ce62ac82ad tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:58.469819 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-337cdbd4-8a03-4ffb-9477-96ce62ac82ad tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:58.476198 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-337cdbd4-8a03-4ffb-9477-96ce62ac82ad tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:58.476638 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-337cdbd4-8a03-4ffb-9477-96ce62ac82ad tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:58.477405 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-337cdbd4-8a03-4ffb-9477-96ce62ac82ad tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:58.477842 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-337cdbd4-8a03-4ffb-9477-96ce62ac82ad tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:58.491698 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-337cdbd4-8a03-4ffb-9477-96ce62ac82ad tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] HTTP exception thrown: Instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 could not be found. Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-337cdbd4-8a03-4ffb-9477-96ce62ac82ad tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Request method failure captured: Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: DELETE /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 HTTP/1.1 Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4n71jdLLlXCyYOPPKqI7T6Cdy-LbAhN31Iw20cgKuY4Ry-3m1V4Pwfdm75FIQbFO5ZuJ-O4GBFbOPX-BZG7U9iM-m1DjpPcdR-Tax9Y17Yq9i3ptRxg6fPm3kFdQhFUFX3gr3NZR3NwBVBrOPLK5AgDwY3kHf5KCAEiLPVQkdMccD4 Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 7caa2a2f7c644b16a76b9dff92a2b2e8 Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeTestJSON-112593294 Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:56:58.493243 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:56:58.494738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7caa2a2f7c644b16a76b9dff92a2b2e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7caa2a2f7c644b16a76b9dff92a2b2e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7caa2a2f7c644b16a76b9dff92a2b2e8", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7caa2a2f7c644b16a76b9dff92a2b2e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:56:58.494738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeTestJSON-112593294 Jun 16 19:56:58.494738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 7caa2a2f7c644b16a76b9dff92a2b2e8 Jun 16 19:56:58.494738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeTestJSON-112593294 Jun 16 19:56:58.494738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeTestJSON-112593294-project Jun 16 19:56:58.494738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:56:58.494738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:56:58.494738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 0251939fa06a45da898a12a37ac91163 Jun 16 19:56:58.494738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeTestJSON-112593294-project Jun 16 19:56:58.494738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:56:58.494738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 could not be found. Jun 16 19:56:58.494738 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': '10e88f61-79c7-4911-a9e4-a0abdf11a512'} Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 could not be found. Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:56:58.495575 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 could not be found. Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 could not be found. Jun 16 19:56:58.497104 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:56:58.498807 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-337cdbd4-8a03-4ffb-9477-96ce62ac82ad tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Returning 404 to user: Instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:56:58.498807 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-337cdbd4-8a03-4ffb-9477-96ce62ac82ad tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "DELETE /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 404 len: 111 microversion: 2.1 time: 0.029176 Jun 16 19:56:58.498807 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 650/1318] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:56:58 2022] DELETE /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:56:58.506451 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-deb4617b-bd5a-4a19-9c3a-10a7340e18b8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:56:58.506451 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-deb4617b-bd5a-4a19-9c3a-10a7340e18b8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] [instance: 10e88f61-79c7-4911-a9e4-a0abdf11a512] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:56:58.510825 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-deb4617b-bd5a-4a19-9c3a-10a7340e18b8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:58.511306 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-deb4617b-bd5a-4a19-9c3a-10a7340e18b8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:58.512067 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-deb4617b-bd5a-4a19-9c3a-10a7340e18b8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:56:58.512508 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-deb4617b-bd5a-4a19-9c3a-10a7340e18b8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:56:58.525707 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-deb4617b-bd5a-4a19-9c3a-10a7340e18b8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] HTTP exception thrown: Instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 could not be found. Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-deb4617b-bd5a-4a19-9c3a-10a7340e18b8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Request method failure captured: Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 HTTP/1.1 Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4n71jdLLlXCyYOPPKqI7T6Cdy-LbAhN31Iw20cgKuY4Ry-3m1V4Pwfdm75FIQbFO5ZuJ-O4GBFbOPX-BZG7U9iM-m1DjpPcdR-Tax9Y17Yq9i3ptRxg6fPm3kFdQhFUFX3gr3NZR3NwBVBrOPLK5AgDwY3kHf5KCAEiLPVQkdMccD4 Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 7caa2a2f7c644b16a76b9dff92a2b2e8 Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-AttachVolumeTestJSON-112593294 Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 19:56:58.527261 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 19:56:58.528979 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7caa2a2f7c644b16a76b9dff92a2b2e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7caa2a2f7c644b16a76b9dff92a2b2e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7caa2a2f7c644b16a76b9dff92a2b2e8", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7caa2a2f7c644b16a76b9dff92a2b2e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:56:58.528979 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-AttachVolumeTestJSON-112593294 Jun 16 19:56:58.528979 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 7caa2a2f7c644b16a76b9dff92a2b2e8 Jun 16 19:56:58.528979 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-AttachVolumeTestJSON-112593294 Jun 16 19:56:58.528979 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-AttachVolumeTestJSON-112593294-project Jun 16 19:56:58.528979 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 19:56:58.528979 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 19:56:58.528979 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 0251939fa06a45da898a12a37ac91163 Jun 16 19:56:58.528979 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-AttachVolumeTestJSON-112593294-project Jun 16 19:56:58.528979 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 19:56:58.528979 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 could not be found. Jun 16 19:56:58.528979 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': '10e88f61-79c7-4911-a9e4-a0abdf11a512'} Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 could not be found. Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:56:58.529963 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:56:58.531521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:56:58.531521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:56:58.531521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:56:58.531521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:56:58.531521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:56:58.531521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:56:58.531521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:56:58.531521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 could not be found. Jun 16 19:56:58.531521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:56:58.531521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:56:58.531521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:56:58.531521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:56:58.531521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:56:58.531521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:56:58.531521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:56:58.531521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:56:58.531521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 could not be found. Jun 16 19:56:58.531521 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 19:56:58.532929 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-deb4617b-bd5a-4a19-9c3a-10a7340e18b8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] Returning 404 to user: Instance 10e88f61-79c7-4911-a9e4-a0abdf11a512 could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:56:58.532929 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-deb4617b-bd5a-4a19-9c3a-10a7340e18b8 tempest-AttachVolumeTestJSON-112593294 tempest-AttachVolumeTestJSON-112593294-project] 10.222.0.36 "GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512" status: 404 len: 111 microversion: 2.1 time: 0.029499 Jun 16 19:56:58.532929 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 669/1319] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:56:58 2022] GET /compute/v2.1/servers/10e88f61-79c7-4911-a9e4-a0abdf11a512 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:57:40.346395 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-18435a8b-747b-4f13-8c96-49ed087c7fa5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:40.346995 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-18435a8b-747b-4f13-8c96-49ed087c7fa5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:40.349116 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:57:40.349768 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:57:40.354469 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-18435a8b-747b-4f13-8c96-49ed087c7fa5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:40.354936 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-18435a8b-747b-4f13-8c96-49ed087c7fa5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:40.355705 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-18435a8b-747b-4f13-8c96-49ed087c7fa5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:40.356141 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-18435a8b-747b-4f13-8c96-49ed087c7fa5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:40.380692 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-18435a8b-747b-4f13-8c96-49ed087c7fa5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Going to try to terminate instance {{(pid=124550) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:57:40.722663 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-18435a8b-747b-4f13-8c96-49ed087c7fa5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 204 len: 0 microversion: 2.1 time: 0.379910 Jun 16 19:57:40.723280 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 651/1320] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 19:57:40 2022] DELETE /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:57:40.731243 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-2ca46fe9-b860-4c19-8e40-c509712e1cd4 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:40.731980 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-2ca46fe9-b860-4c19-8e40-c509712e1cd4 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:40.734254 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:57:40.734896 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:57:40.740165 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2ca46fe9-b860-4c19-8e40-c509712e1cd4 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:40.740608 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2ca46fe9-b860-4c19-8e40-c509712e1cd4 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:40.741369 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2ca46fe9-b860-4c19-8e40-c509712e1cd4 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:40.741806 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-2ca46fe9-b860-4c19-8e40-c509712e1cd4 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:40.874077 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-2ca46fe9-b860-4c19-8e40-c509712e1cd4 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:40.882539 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-2ca46fe9-b860-4c19-8e40-c509712e1cd4 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1578 microversion: 2.1 time: 0.155106 Jun 16 19:57:40.883198 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 670/1321] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:40 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:57:41.900658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-093b87bc-dc40-4da3-9c1d-a8f86360eec5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:41.901355 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-093b87bc-dc40-4da3-9c1d-a8f86360eec5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:41.908247 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-093b87bc-dc40-4da3-9c1d-a8f86360eec5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:41.908690 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-093b87bc-dc40-4da3-9c1d-a8f86360eec5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:41.909464 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-093b87bc-dc40-4da3-9c1d-a8f86360eec5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:41.909893 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-093b87bc-dc40-4da3-9c1d-a8f86360eec5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:42.320397 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-093b87bc-dc40-4da3-9c1d-a8f86360eec5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:42.328386 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-093b87bc-dc40-4da3-9c1d-a8f86360eec5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1578 microversion: 2.1 time: 0.432573 Jun 16 19:57:42.328951 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 652/1322] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:41 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1578 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:57:43.345948 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b086865c-dbb1-4923-85ad-ef5a7aa8faf1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:43.346591 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b086865c-dbb1-4923-85ad-ef5a7aa8faf1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:43.353998 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b086865c-dbb1-4923-85ad-ef5a7aa8faf1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:43.354454 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b086865c-dbb1-4923-85ad-ef5a7aa8faf1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:43.355250 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b086865c-dbb1-4923-85ad-ef5a7aa8faf1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:43.355687 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b086865c-dbb1-4923-85ad-ef5a7aa8faf1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:43.419170 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b086865c-dbb1-4923-85ad-ef5a7aa8faf1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:43.427273 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b086865c-dbb1-4923-85ad-ef5a7aa8faf1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1511 microversion: 2.1 time: 0.085478 Jun 16 19:57:43.428033 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 671/1323] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:43 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1511 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:57:43.447506 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-d9e0badf-cde5-4ba3-9b60-b2342b1e210c req-bc2f5a5a-baae-45a4-b14e-a0c45cd3026f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1", "name": "network-vif-deleted", "tag": "26f4f314-2ae9-4591-86be-783a8b8117d6"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:57:43.456269 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-d9e0badf-cde5-4ba3-9b60-b2342b1e210c req-bc2f5a5a-baae-45a4-b14e-a0c45cd3026f service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:43.459400 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-d9e0badf-cde5-4ba3-9b60-b2342b1e210c req-bc2f5a5a-baae-45a4-b14e-a0c45cd3026f service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:43.468529 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-d9e0badf-cde5-4ba3-9b60-b2342b1e210c req-bc2f5a5a-baae-45a4-b14e-a0c45cd3026f service nova] Creating event network-vif-deleted:26f4f314-2ae9-4591-86be-783a8b8117d6 for instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 on hv-cinder-84617 Jun 16 19:57:43.473548 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-d9e0badf-cde5-4ba3-9b60-b2342b1e210c req-bc2f5a5a-baae-45a4-b14e-a0c45cd3026f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029694 Jun 16 19:57:43.474474 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 653/1324] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:57:44.449710 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e10c6f7f-eebb-4b1a-bd0d-0e7914917e5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:44.449710 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e10c6f7f-eebb-4b1a-bd0d-0e7914917e5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:44.456929 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e10c6f7f-eebb-4b1a-bd0d-0e7914917e5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:44.457381 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e10c6f7f-eebb-4b1a-bd0d-0e7914917e5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:44.459120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e10c6f7f-eebb-4b1a-bd0d-0e7914917e5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:44.462107 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e10c6f7f-eebb-4b1a-bd0d-0e7914917e5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:44.514161 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e10c6f7f-eebb-4b1a-bd0d-0e7914917e5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:44.514655 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e10c6f7f-eebb-4b1a-bd0d-0e7914917e5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:44.515128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-e10c6f7f-eebb-4b1a-bd0d-0e7914917e5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lazy-loading 'fault' on Instance uuid c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:57:44.559171 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e10c6f7f-eebb-4b1a-bd0d-0e7914917e5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:44.567821 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e10c6f7f-eebb-4b1a-bd0d-0e7914917e5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 200 len: 1231 microversion: 2.1 time: 0.127056 Jun 16 19:57:44.568379 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 672/1325] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:44 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 1231 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:57:45.586012 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c750c494-ee31-42de-ad67-5cada20b1202 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:45.586715 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c750c494-ee31-42de-ad67-5cada20b1202 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:45.593089 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c750c494-ee31-42de-ad67-5cada20b1202 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:45.593535 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c750c494-ee31-42de-ad67-5cada20b1202 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:45.594287 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c750c494-ee31-42de-ad67-5cada20b1202 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:45.594773 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c750c494-ee31-42de-ad67-5cada20b1202 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:45.608298 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-c750c494-ee31-42de-ad67-5cada20b1202 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] HTTP exception thrown: Instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 could not be found. Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c750c494-ee31-42de-ad67-5cada20b1202 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Request method failure captured: Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 HTTP/1.1 Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4qJ-mDowd0vMRoMinbGeRpffdfRvenT_O4XWSRu-sy8pnrWl1pABx4k5q78F7c-QnjbowXZ7vS5bah_6QCnslOK3_GquBdBHnTTDrNoO5PnnTUXSIoIu3X_oLuWswnZR30xI393MjmE19tgo1Lpn3nNW23r58IcvL_oDIy5ZT0k_Y4 Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 6e652ff475764534b6cc03cb64b7d069 Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-TestVolumeBootPattern-69831965 Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 19:57:45.609939 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 19:57:45.611828 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e652ff475764534b6cc03cb64b7d069"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6e652ff475764534b6cc03cb64b7d069"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6e652ff475764534b6cc03cb64b7d069", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e652ff475764534b6cc03cb64b7d069"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 19:57:45.611828 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-TestVolumeBootPattern-69831965 Jun 16 19:57:45.611828 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 6e652ff475764534b6cc03cb64b7d069 Jun 16 19:57:45.611828 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-TestVolumeBootPattern-69831965 Jun 16 19:57:45.611828 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-TestVolumeBootPattern-69831965-project Jun 16 19:57:45.611828 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 19:57:45.611828 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 19:57:45.611828 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 19fc9ffd436d4068a89686da8b4f2997 Jun 16 19:57:45.611828 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-TestVolumeBootPattern-69831965-project Jun 16 19:57:45.611828 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 19:57:45.611828 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 could not be found. Jun 16 19:57:45.611828 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': 'c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1'} Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 could not be found. Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:57:45.612816 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:57:45.614363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:57:45.614363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:57:45.614363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:57:45.614363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:57:45.614363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:57:45.614363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:57:45.614363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:57:45.614363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 could not be found. Jun 16 19:57:45.614363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:57:45.614363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:57:45.614363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:57:45.614363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:57:45.614363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:57:45.614363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:57:45.614363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:57:45.614363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:57:45.614363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 could not be found. Jun 16 19:57:45.614363 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 19:57:45.616876 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c750c494-ee31-42de-ad67-5cada20b1202 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Returning 404 to user: Instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:57:45.616876 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c750c494-ee31-42de-ad67-5cada20b1202 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 404 len: 111 microversion: 2.1 time: 0.030222 Jun 16 19:57:45.616876 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 654/1326] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:45 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:57:45.706959 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-41848fb7-b005-44e6-85ea-bc43535c9664 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1045746297", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1913068007", "security_groups": [{"name": "tempest-secgroup-smoke-715222250"}], "block_device_mapping_v2": [{"uuid": "90d5d9c2-3803-4538-96c3-0e54f0454f99", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ef179745-884d-48cf-ae3f-2f015474cf3f"}]}} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:57:45.816809 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.network.neutron [None req-41848fb7-b005-44e6-85ea-bc43535c9664 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] validate_networks() for [('ef179745-884d-48cf-ae3f-2f015474cf3f', None, None, None, None, None)] {{(pid=124551) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:57:46.174726 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-41848fb7-b005-44e6-85ea-bc43535c9664 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Flavor limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:57:46.175182 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-41848fb7-b005-44e6-85ea-bc43535c9664 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Image limits 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:57:46.175688 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-41848fb7-b005-44e6-85ea-bc43535c9664 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Flavor pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:57:46.176102 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-41848fb7-b005-44e6-85ea-bc43535c9664 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Image pref 0:0:0 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:57:46.176548 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.virt.hardware [None req-41848fb7-b005-44e6-85ea-bc43535c9664 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124551) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:57:46.185394 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-41848fb7-b005-44e6-85ea-bc43535c9664 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:46.185840 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-41848fb7-b005-44e6-85ea-bc43535c9664 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:46.186636 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-41848fb7-b005-44e6-85ea-bc43535c9664 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:46.187112 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-41848fb7-b005-44e6-85ea-bc43535c9664 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:46.203450 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-41848fb7-b005-44e6-85ea-bc43535c9664 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Getting quotas for project 6e652ff475764534b6cc03cb64b7d069. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:57:46.207300 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.quota [None req-41848fb7-b005-44e6-85ea-bc43535c9664 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Getting quotas for user 19fc9ffd436d4068a89686da8b4f2997 and project 6e652ff475764534b6cc03cb64b7d069. Resources: {'instances', 'cores', 'ram'} {{(pid=124551) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:57:46.263459 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-41848fb7-b005-44e6-85ea-bc43535c9664 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Going to run 1 instances... {{(pid=124551) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:57:46.265525 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-41848fb7-b005-44e6-85ea-bc43535c9664 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='90d5d9c2-3803-4538-96c3-0e54f0454f99',volume_size=None,volume_type=None)] {{(pid=124551) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:57:46.712193 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-41848fb7-b005-44e6-85ea-bc43535c9664 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.009113 Jun 16 19:57:46.712888 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 673/1327] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:57:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:57:46.723208 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-94f92437-6516-4a30-9706-c4424b9f1353 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:46.723884 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-94f92437-6516-4a30-9706-c4424b9f1353 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:46.781766 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-94f92437-6516-4a30-9706-c4424b9f1353 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:46.788880 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-94f92437-6516-4a30-9706-c4424b9f1353 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1095 microversion: 2.1 time: 0.069880 Jun 16 19:57:46.789852 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 655/1328] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:46 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:57:47.807345 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-5cea07f4-413a-4fef-be92-3840afc4fb0f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:47.807910 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-5cea07f4-413a-4fef-be92-3840afc4fb0f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:47.813931 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5cea07f4-413a-4fef-be92-3840afc4fb0f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:47.814374 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5cea07f4-413a-4fef-be92-3840afc4fb0f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:47.815159 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5cea07f4-413a-4fef-be92-3840afc4fb0f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:47.815595 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-5cea07f4-413a-4fef-be92-3840afc4fb0f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:47.875554 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-5cea07f4-413a-4fef-be92-3840afc4fb0f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:47.882944 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-5cea07f4-413a-4fef-be92-3840afc4fb0f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1137 microversion: 2.1 time: 0.080075 Jun 16 19:57:47.883490 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 674/1329] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:47 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1137 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:57:48.899648 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-43e1a83e-b047-476b-b90d-9ef7059c2209 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:48.900218 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-43e1a83e-b047-476b-b90d-9ef7059c2209 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:48.907456 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-43e1a83e-b047-476b-b90d-9ef7059c2209 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:48.907916 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-43e1a83e-b047-476b-b90d-9ef7059c2209 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:48.908685 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-43e1a83e-b047-476b-b90d-9ef7059c2209 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:48.909118 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-43e1a83e-b047-476b-b90d-9ef7059c2209 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:48.997829 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-43e1a83e-b047-476b-b90d-9ef7059c2209 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:49.006635 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-43e1a83e-b047-476b-b90d-9ef7059c2209 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1211 microversion: 2.1 time: 0.111325 Jun 16 19:57:49.007099 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 656/1330] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:48 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1211 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:57:50.023562 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-149dc865-609b-42ec-b255-59ecb5d2b0ad tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:50.024397 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-149dc865-609b-42ec-b255-59ecb5d2b0ad tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:50.030835 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-149dc865-609b-42ec-b255-59ecb5d2b0ad tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:50.031329 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-149dc865-609b-42ec-b255-59ecb5d2b0ad tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:50.032135 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-149dc865-609b-42ec-b255-59ecb5d2b0ad tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:50.032569 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-149dc865-609b-42ec-b255-59ecb5d2b0ad tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:50.168443 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-149dc865-609b-42ec-b255-59ecb5d2b0ad tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:50.176154 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-149dc865-609b-42ec-b255-59ecb5d2b0ad tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1278 microversion: 2.1 time: 0.156543 Jun 16 19:57:50.176708 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 675/1331] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:50 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:57:50.727833 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-9f8d6a1a-bcb3-478f-abcd-ae3b65a5a6df req-8d0c342a-abe2-41e2-b0af-d1354a534b11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8db2f00-89b3-4ac1-97b3-1a105e3c2428", "tag": "905498af-f13a-4575-a0a1-dbf42535dcf6"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:57:50.736801 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-9f8d6a1a-bcb3-478f-abcd-ae3b65a5a6df req-8d0c342a-abe2-41e2-b0af-d1354a534b11 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:50.737495 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-9f8d6a1a-bcb3-478f-abcd-ae3b65a5a6df req-8d0c342a-abe2-41e2-b0af-d1354a534b11 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:50.749950 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-9f8d6a1a-bcb3-478f-abcd-ae3b65a5a6df req-8d0c342a-abe2-41e2-b0af-d1354a534b11 service nova] Creating event network-changed:905498af-f13a-4575-a0a1-dbf42535dcf6 for instance d8db2f00-89b3-4ac1-97b3-1a105e3c2428 on hv-cinder-84617 Jun 16 19:57:50.756839 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-9f8d6a1a-bcb3-478f-abcd-ae3b65a5a6df req-8d0c342a-abe2-41e2-b0af-d1354a534b11 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033123 Jun 16 19:57:50.757502 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 657/1332] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:57:51.196260 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-45bbf87f-29db-4285-a290-6456ac13c301 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:51.196825 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-45bbf87f-29db-4285-a290-6456ac13c301 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:51.204100 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-45bbf87f-29db-4285-a290-6456ac13c301 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:51.204549 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-45bbf87f-29db-4285-a290-6456ac13c301 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:51.205308 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-45bbf87f-29db-4285-a290-6456ac13c301 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:51.205736 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-45bbf87f-29db-4285-a290-6456ac13c301 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:51.336978 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-45bbf87f-29db-4285-a290-6456ac13c301 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:51.344410 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-45bbf87f-29db-4285-a290-6456ac13c301 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1266 microversion: 2.1 time: 0.152661 Jun 16 19:57:51.345316 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 676/1333] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:51 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:57:52.362444 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ab77b891-ac77-4749-ac66-bf27cc15424f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:52.363167 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ab77b891-ac77-4749-ac66-bf27cc15424f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:52.369440 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ab77b891-ac77-4749-ac66-bf27cc15424f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:52.369890 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ab77b891-ac77-4749-ac66-bf27cc15424f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:52.370648 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ab77b891-ac77-4749-ac66-bf27cc15424f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:52.371118 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ab77b891-ac77-4749-ac66-bf27cc15424f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:52.501934 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ab77b891-ac77-4749-ac66-bf27cc15424f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:52.509951 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ab77b891-ac77-4749-ac66-bf27cc15424f tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1266 microversion: 2.1 time: 0.152194 Jun 16 19:57:52.510503 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 658/1334] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:52 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:57:53.526527 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-83d82093-463e-464a-87ba-24051732b6e3 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:53.527169 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-83d82093-463e-464a-87ba-24051732b6e3 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:53.533749 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-83d82093-463e-464a-87ba-24051732b6e3 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:53.534190 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-83d82093-463e-464a-87ba-24051732b6e3 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:53.534948 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-83d82093-463e-464a-87ba-24051732b6e3 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:53.535394 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-83d82093-463e-464a-87ba-24051732b6e3 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:53.659872 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-83d82093-463e-464a-87ba-24051732b6e3 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:53.667320 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-83d82093-463e-464a-87ba-24051732b6e3 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1266 microversion: 2.1 time: 0.144485 Jun 16 19:57:53.667886 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 677/1335] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:53 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:57:54.684479 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7a05f0aa-c49a-4b85-a68e-40b055a04f8e tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:54.685170 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7a05f0aa-c49a-4b85-a68e-40b055a04f8e tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:54.691326 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7a05f0aa-c49a-4b85-a68e-40b055a04f8e tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:54.691788 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7a05f0aa-c49a-4b85-a68e-40b055a04f8e tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:54.693064 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7a05f0aa-c49a-4b85-a68e-40b055a04f8e tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:54.693504 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7a05f0aa-c49a-4b85-a68e-40b055a04f8e tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:54.818619 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7a05f0aa-c49a-4b85-a68e-40b055a04f8e tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:54.826249 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7a05f0aa-c49a-4b85-a68e-40b055a04f8e tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1266 microversion: 2.1 time: 0.146061 Jun 16 19:57:54.826802 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 659/1336] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:54 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:57:55.843325 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e10f3c41-445c-4eb8-84bd-0fc2a05763bf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:55.843921 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e10f3c41-445c-4eb8-84bd-0fc2a05763bf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:55.850334 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e10f3c41-445c-4eb8-84bd-0fc2a05763bf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:55.850832 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e10f3c41-445c-4eb8-84bd-0fc2a05763bf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:55.851612 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e10f3c41-445c-4eb8-84bd-0fc2a05763bf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:55.852044 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-e10f3c41-445c-4eb8-84bd-0fc2a05763bf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:55.981901 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e10f3c41-445c-4eb8-84bd-0fc2a05763bf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:55.990063 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e10f3c41-445c-4eb8-84bd-0fc2a05763bf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1266 microversion: 2.1 time: 0.150015 Jun 16 19:57:55.990603 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 678/1337] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:55 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:57:57.007217 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8e1f5681-84fb-4997-b988-dbbb534770fb tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:57.007827 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8e1f5681-84fb-4997-b988-dbbb534770fb tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:57.010199 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:57:57.015036 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8e1f5681-84fb-4997-b988-dbbb534770fb tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:57.015480 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8e1f5681-84fb-4997-b988-dbbb534770fb tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:57.016228 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8e1f5681-84fb-4997-b988-dbbb534770fb tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:57.016656 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8e1f5681-84fb-4997-b988-dbbb534770fb tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:57.146980 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8e1f5681-84fb-4997-b988-dbbb534770fb tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:57.154415 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8e1f5681-84fb-4997-b988-dbbb534770fb tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1266 microversion: 2.1 time: 0.151555 Jun 16 19:57:57.154983 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 660/1338] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:57 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:57:58.172130 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-b4aa2607-5f6b-4013-a25a-95f03b824699 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:58.172767 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-b4aa2607-5f6b-4013-a25a-95f03b824699 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:58.174582 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=2 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:57:58.175290 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=6 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:57:58.180486 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b4aa2607-5f6b-4013-a25a-95f03b824699 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:58.180936 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b4aa2607-5f6b-4013-a25a-95f03b824699 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:58.181724 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b4aa2607-5f6b-4013-a25a-95f03b824699 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:58.182163 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-b4aa2607-5f6b-4013-a25a-95f03b824699 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:58.310897 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-b4aa2607-5f6b-4013-a25a-95f03b824699 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:58.318841 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-b4aa2607-5f6b-4013-a25a-95f03b824699 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1266 microversion: 2.1 time: 0.150602 Jun 16 19:57:58.319422 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 679/1339] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:58 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:57:59.336605 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-74290127-6a10-470e-921a-8ec74bfe7964 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:57:59.337197 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-74290127-6a10-470e-921a-8ec74bfe7964 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:57:59.343802 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74290127-6a10-470e-921a-8ec74bfe7964 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:59.344247 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74290127-6a10-470e-921a-8ec74bfe7964 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:59.345008 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74290127-6a10-470e-921a-8ec74bfe7964 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:57:59.345443 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74290127-6a10-470e-921a-8ec74bfe7964 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:57:59.473245 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-74290127-6a10-470e-921a-8ec74bfe7964 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:57:59.481269 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-74290127-6a10-470e-921a-8ec74bfe7964 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1266 microversion: 2.1 time: 0.149098 Jun 16 19:57:59.481830 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 661/1340] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:57:59 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:58:00.498734 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6dd3a69d-aeb9-4191-9c97-d1cc1c3d6ce0 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:58:00.499412 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6dd3a69d-aeb9-4191-9c97-d1cc1c3d6ce0 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:58:00.505916 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6dd3a69d-aeb9-4191-9c97-d1cc1c3d6ce0 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:58:00.506367 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6dd3a69d-aeb9-4191-9c97-d1cc1c3d6ce0 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:58:00.507164 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6dd3a69d-aeb9-4191-9c97-d1cc1c3d6ce0 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:58:00.507614 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6dd3a69d-aeb9-4191-9c97-d1cc1c3d6ce0 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:58:00.645201 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6dd3a69d-aeb9-4191-9c97-d1cc1c3d6ce0 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:58:00.653035 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6dd3a69d-aeb9-4191-9c97-d1cc1c3d6ce0 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1266 microversion: 2.1 time: 0.158457 Jun 16 19:58:00.653592 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 680/1341] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:58:00 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:58:01.670076 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-93016e54-d23c-4e26-b5db-5cf4499bcb3b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:58:01.670686 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-93016e54-d23c-4e26-b5db-5cf4499bcb3b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:58:01.677156 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93016e54-d23c-4e26-b5db-5cf4499bcb3b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:58:01.677605 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93016e54-d23c-4e26-b5db-5cf4499bcb3b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:58:01.678366 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93016e54-d23c-4e26-b5db-5cf4499bcb3b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:58:01.678804 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93016e54-d23c-4e26-b5db-5cf4499bcb3b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:58:01.817476 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-93016e54-d23c-4e26-b5db-5cf4499bcb3b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:58:01.823841 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-93016e54-d23c-4e26-b5db-5cf4499bcb3b tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1266 microversion: 2.1 time: 0.157575 Jun 16 19:58:01.824679 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 662/1342] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:58:01 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:58:01.871141 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-0ed65fda-8a4f-47be-aa66-064ac25c576f req-53670e35-fa92-4fae-b926-8dfa969fd75a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8db2f00-89b3-4ac1-97b3-1a105e3c2428", "name": "network-vif-plugged", "status": "completed", "tag": "905498af-f13a-4575-a0a1-dbf42535dcf6"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:58:01.879675 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-0ed65fda-8a4f-47be-aa66-064ac25c576f req-53670e35-fa92-4fae-b926-8dfa969fd75a service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:58:01.880111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-0ed65fda-8a4f-47be-aa66-064ac25c576f req-53670e35-fa92-4fae-b926-8dfa969fd75a service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:58:01.890844 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-0ed65fda-8a4f-47be-aa66-064ac25c576f req-53670e35-fa92-4fae-b926-8dfa969fd75a service nova] Creating event network-vif-plugged:905498af-f13a-4575-a0a1-dbf42535dcf6 for instance d8db2f00-89b3-4ac1-97b3-1a105e3c2428 on hv-cinder-84617 Jun 16 19:58:01.895939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-0ed65fda-8a4f-47be-aa66-064ac25c576f req-53670e35-fa92-4fae-b926-8dfa969fd75a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029111 Jun 16 19:58:01.896516 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 681/1343] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:58:02.841765 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-56a100f5-8305-432d-929e-bb81732cdc89 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:58:02.842397 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-56a100f5-8305-432d-929e-bb81732cdc89 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:58:02.848830 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-56a100f5-8305-432d-929e-bb81732cdc89 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:58:02.849310 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-56a100f5-8305-432d-929e-bb81732cdc89 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:58:02.850066 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-56a100f5-8305-432d-929e-bb81732cdc89 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:58:02.850503 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-56a100f5-8305-432d-929e-bb81732cdc89 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:58:02.980069 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-56a100f5-8305-432d-929e-bb81732cdc89 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:58:02.987385 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-56a100f5-8305-432d-929e-bb81732cdc89 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1266 microversion: 2.1 time: 0.149965 Jun 16 19:58:02.987941 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 663/1344] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:58:02 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:58:04.004220 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-63c75ae8-2b4c-4b51-a024-51cb21b31a6a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:58:04.004908 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-63c75ae8-2b4c-4b51-a024-51cb21b31a6a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:58:04.012600 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-63c75ae8-2b4c-4b51-a024-51cb21b31a6a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:58:04.013047 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-63c75ae8-2b4c-4b51-a024-51cb21b31a6a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:58:04.013795 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-63c75ae8-2b4c-4b51-a024-51cb21b31a6a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:58:04.014227 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-63c75ae8-2b4c-4b51-a024-51cb21b31a6a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:58:04.142523 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-63c75ae8-2b4c-4b51-a024-51cb21b31a6a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:58:04.149895 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-63c75ae8-2b4c-4b51-a024-51cb21b31a6a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1452 microversion: 2.1 time: 0.150254 Jun 16 19:58:04.150453 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 682/1345] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:58:03 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:58:04.165636 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-228af25b-5523-436f-9a4d-153afb596b84 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:58:04.166246 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-228af25b-5523-436f-9a4d-153afb596b84 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:58:04.173219 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-228af25b-5523-436f-9a4d-153afb596b84 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:58:04.173661 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-228af25b-5523-436f-9a4d-153afb596b84 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:58:04.174417 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-228af25b-5523-436f-9a4d-153afb596b84 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:58:04.174849 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-228af25b-5523-436f-9a4d-153afb596b84 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:58:04.301880 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-228af25b-5523-436f-9a4d-153afb596b84 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:58:04.309892 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-228af25b-5523-436f-9a4d-153afb596b84 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1452 microversion: 2.1 time: 0.148124 Jun 16 19:58:04.313823 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 664/1346] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:58:04 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:58:06.310087 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-08018d54-321a-466c-810d-84260a571006 req-c0370c25-ae38-47ee-a220-958c74e731c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8db2f00-89b3-4ac1-97b3-1a105e3c2428", "tag": "905498af-f13a-4575-a0a1-dbf42535dcf6"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:58:06.319223 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-08018d54-321a-466c-810d-84260a571006 req-c0370c25-ae38-47ee-a220-958c74e731c3 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:58:06.319599 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-08018d54-321a-466c-810d-84260a571006 req-c0370c25-ae38-47ee-a220-958c74e731c3 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:58:06.331183 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-08018d54-321a-466c-810d-84260a571006 req-c0370c25-ae38-47ee-a220-958c74e731c3 service nova] Creating event network-changed:905498af-f13a-4575-a0a1-dbf42535dcf6 for instance d8db2f00-89b3-4ac1-97b3-1a105e3c2428 on hv-cinder-84617 Jun 16 19:58:06.336198 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-08018d54-321a-466c-810d-84260a571006 req-c0370c25-ae38-47ee-a220-958c74e731c3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030404 Jun 16 19:58:06.336790 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 683/1347] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:58:54.206761 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:58:54.207302 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Thu Jun 16 19:58:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:59:46.374665 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:59:46.375452 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:59:46.379322 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ec9be397-4be4-414f-b51d-4f5d8ff27cd1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2040682184", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1913068007", "security_groups": [{"name": "tempest-secgroup-smoke-715222250"}], "block_device_mapping_v2": [{"uuid": "fcc6b5ce-8a44-4cc6-800f-f37b3d9a1c7f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ef179745-884d-48cf-ae3f-2f015474cf3f"}]}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:59:46.671611 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-ec9be397-4be4-414f-b51d-4f5d8ff27cd1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] validate_networks() for [('ef179745-884d-48cf-ae3f-2f015474cf3f', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:59:47.130601 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-ec9be397-4be4-414f-b51d-4f5d8ff27cd1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:59:47.131068 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-ec9be397-4be4-414f-b51d-4f5d8ff27cd1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:59:47.131539 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-ec9be397-4be4-414f-b51d-4f5d8ff27cd1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:59:47.131943 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-ec9be397-4be4-414f-b51d-4f5d8ff27cd1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:59:47.132381 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-ec9be397-4be4-414f-b51d-4f5d8ff27cd1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:59:47.140888 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec9be397-4be4-414f-b51d-4f5d8ff27cd1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:47.141329 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec9be397-4be4-414f-b51d-4f5d8ff27cd1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:47.142117 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec9be397-4be4-414f-b51d-4f5d8ff27cd1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:47.142552 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ec9be397-4be4-414f-b51d-4f5d8ff27cd1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:47.158534 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-ec9be397-4be4-414f-b51d-4f5d8ff27cd1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Getting quotas for project 6e652ff475764534b6cc03cb64b7d069. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:59:47.162464 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-ec9be397-4be4-414f-b51d-4f5d8ff27cd1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Getting quotas for user 19fc9ffd436d4068a89686da8b4f2997 and project 6e652ff475764534b6cc03cb64b7d069. Resources: {'instances', 'cores', 'ram'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:59:47.218212 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ec9be397-4be4-414f-b51d-4f5d8ff27cd1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:59:47.220321 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ec9be397-4be4-414f-b51d-4f5d8ff27cd1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fcc6b5ce-8a44-4cc6-800f-f37b3d9a1c7f',volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:59:47.690695 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ec9be397-4be4-414f-b51d-4f5d8ff27cd1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.317710 Jun 16 19:59:47.691691 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 665/1348] 10.222.0.36 () {60 vars in 1146 bytes} [Thu Jun 16 19:59:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:59:47.699839 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:59:47.700953 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=74 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:59:47.705440 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-e339d156-1445-427b-b014-b6c30f5c5574 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:59:47.706806 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-e339d156-1445-427b-b014-b6c30f5c5574 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:59:47.815759 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-e339d156-1445-427b-b014-b6c30f5c5574 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:59:47.822990 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-e339d156-1445-427b-b014-b6c30f5c5574 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1095 microversion: 2.1 time: 0.125107 Jun 16 19:59:47.823638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 684/1349] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:59:47 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1095 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:59:48.840860 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a047ab95-2081-4abc-9cf0-5d09e98b66aa tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:59:48.841522 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a047ab95-2081-4abc-9cf0-5d09e98b66aa tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:59:48.848395 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a047ab95-2081-4abc-9cf0-5d09e98b66aa tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:48.848836 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a047ab95-2081-4abc-9cf0-5d09e98b66aa tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:48.849598 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a047ab95-2081-4abc-9cf0-5d09e98b66aa tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:48.850034 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a047ab95-2081-4abc-9cf0-5d09e98b66aa tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:48.908468 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a047ab95-2081-4abc-9cf0-5d09e98b66aa tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:59:48.915828 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a047ab95-2081-4abc-9cf0-5d09e98b66aa tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1145 microversion: 2.1 time: 0.079818 Jun 16 19:59:48.916385 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 666/1350] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:59:48 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:59:49.932508 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-885f8865-d7af-4b72-be04-8373f169e5a7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:59:49.933112 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-885f8865-d7af-4b72-be04-8373f169e5a7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:59:49.936533 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d38df78f-60af-427b-ace5-5937b55156b2] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 16 19:59:49.940061 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-885f8865-d7af-4b72-be04-8373f169e5a7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:49.940516 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-885f8865-d7af-4b72-be04-8373f169e5a7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:49.941286 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-885f8865-d7af-4b72-be04-8373f169e5a7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:49.941724 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-885f8865-d7af-4b72-be04-8373f169e5a7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:50.260319 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-885f8865-d7af-4b72-be04-8373f169e5a7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:59:50.267770 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-885f8865-d7af-4b72-be04-8373f169e5a7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1145 microversion: 2.1 time: 0.339215 Jun 16 19:59:50.271346 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 685/1351] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:59:49 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1145 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:59:51.284320 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0e068dde-1364-45a5-a9e8-e59788edbd49 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:59:51.284935 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0e068dde-1364-45a5-a9e8-e59788edbd49 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:59:51.292105 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e068dde-1364-45a5-a9e8-e59788edbd49 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:51.292622 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e068dde-1364-45a5-a9e8-e59788edbd49 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:51.293390 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e068dde-1364-45a5-a9e8-e59788edbd49 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:51.293829 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e068dde-1364-45a5-a9e8-e59788edbd49 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:51.371257 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0e068dde-1364-45a5-a9e8-e59788edbd49 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:59:51.378676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0e068dde-1364-45a5-a9e8-e59788edbd49 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1211 microversion: 2.1 time: 0.098251 Jun 16 19:59:51.379391 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 667/1352] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:59:51 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:59:52.402190 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0859bfa7-7d3a-4eef-a251-478ff34ef9ef tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:59:52.403221 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0859bfa7-7d3a-4eef-a251-478ff34ef9ef tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:59:52.410901 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0859bfa7-7d3a-4eef-a251-478ff34ef9ef tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:52.411686 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0859bfa7-7d3a-4eef-a251-478ff34ef9ef tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:52.412756 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0859bfa7-7d3a-4eef-a251-478ff34ef9ef tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:52.415937 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0859bfa7-7d3a-4eef-a251-478ff34ef9ef tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:52.440449 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO oslo.messaging._drivers.impl_rabbit [-] [d38df78f-60af-427b-ace5-5937b55156b2] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 35538. Jun 16 19:59:52.553400 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0859bfa7-7d3a-4eef-a251-478ff34ef9ef tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:59:52.561668 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0859bfa7-7d3a-4eef-a251-478ff34ef9ef tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1278 microversion: 2.1 time: 0.164638 Jun 16 19:59:52.562831 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 686/1353] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:59:52 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:59:52.798109 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-c9a48fd8-66f0-4e87-adbb-afbd08a3bac7 req-c461f7b5-d5ec-4dc3-a8db-b2b122048167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afd66312-6e27-4f38-8a5c-ab922b0b3ba5", "tag": "d85ecb16-693d-41c7-bba8-7edd4c259667"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:59:52.806682 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-c9a48fd8-66f0-4e87-adbb-afbd08a3bac7 req-c461f7b5-d5ec-4dc3-a8db-b2b122048167 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:52.807148 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-c9a48fd8-66f0-4e87-adbb-afbd08a3bac7 req-c461f7b5-d5ec-4dc3-a8db-b2b122048167 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:52.821308 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-c9a48fd8-66f0-4e87-adbb-afbd08a3bac7 req-c461f7b5-d5ec-4dc3-a8db-b2b122048167 service nova] Creating event network-changed:d85ecb16-693d-41c7-bba8-7edd4c259667 for instance afd66312-6e27-4f38-8a5c-ab922b0b3ba5 on hv-cinder-84617 Jun 16 19:59:52.826345 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-c9a48fd8-66f0-4e87-adbb-afbd08a3bac7 req-c461f7b5-d5ec-4dc3-a8db-b2b122048167 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098161 Jun 16 19:59:52.827003 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 668/1354] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 19:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:59:53.579685 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-7f49b17b-cafb-4883-91fc-1826d072b464 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:59:53.580306 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-7f49b17b-cafb-4883-91fc-1826d072b464 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:59:53.586806 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7f49b17b-cafb-4883-91fc-1826d072b464 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:53.587292 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7f49b17b-cafb-4883-91fc-1826d072b464 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:53.588080 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7f49b17b-cafb-4883-91fc-1826d072b464 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:53.588520 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-7f49b17b-cafb-4883-91fc-1826d072b464 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:53.719680 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-7f49b17b-cafb-4883-91fc-1826d072b464 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:59:53.727120 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-7f49b17b-cafb-4883-91fc-1826d072b464 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1266 microversion: 2.1 time: 0.151470 Jun 16 19:59:53.727711 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 687/1355] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:59:53 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:59:54.744908 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4f27bb21-36e0-409c-b034-65f126fb4641 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:59:54.745603 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4f27bb21-36e0-409c-b034-65f126fb4641 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:59:54.751762 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4f27bb21-36e0-409c-b034-65f126fb4641 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:54.752211 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4f27bb21-36e0-409c-b034-65f126fb4641 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:54.752971 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4f27bb21-36e0-409c-b034-65f126fb4641 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:54.753405 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4f27bb21-36e0-409c-b034-65f126fb4641 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:54.881116 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4f27bb21-36e0-409c-b034-65f126fb4641 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:59:54.889081 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4f27bb21-36e0-409c-b034-65f126fb4641 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1266 microversion: 2.1 time: 0.148883 Jun 16 19:59:54.889636 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 669/1356] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:59:54 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:59:55.905494 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d2ad69aa-ca35-4f46-9480-9fd7cf5d7bb1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:59:55.906096 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d2ad69aa-ca35-4f46-9480-9fd7cf5d7bb1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:59:55.912653 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d2ad69aa-ca35-4f46-9480-9fd7cf5d7bb1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:55.913109 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d2ad69aa-ca35-4f46-9480-9fd7cf5d7bb1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:55.914439 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d2ad69aa-ca35-4f46-9480-9fd7cf5d7bb1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:55.914896 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d2ad69aa-ca35-4f46-9480-9fd7cf5d7bb1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:56.042846 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d2ad69aa-ca35-4f46-9480-9fd7cf5d7bb1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:59:56.050188 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d2ad69aa-ca35-4f46-9480-9fd7cf5d7bb1 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1266 microversion: 2.1 time: 0.148505 Jun 16 19:59:56.050828 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 688/1357] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:59:55 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:59:57.118333 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-69987ff8-d7b3-4e42-96df-828eb891a20a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:59:57.118977 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-69987ff8-d7b3-4e42-96df-828eb891a20a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:59:57.124868 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-69987ff8-d7b3-4e42-96df-828eb891a20a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:57.125310 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-69987ff8-d7b3-4e42-96df-828eb891a20a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:57.126057 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-69987ff8-d7b3-4e42-96df-828eb891a20a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:57.126485 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-69987ff8-d7b3-4e42-96df-828eb891a20a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:57.149206 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:59:57.169729 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=6 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:59:57.258230 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-69987ff8-d7b3-4e42-96df-828eb891a20a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:59:57.265599 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-69987ff8-d7b3-4e42-96df-828eb891a20a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1266 microversion: 2.1 time: 0.202179 Jun 16 19:59:57.266150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 670/1358] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:59:57 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:59:58.282840 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-c9618c4c-ed8e-4d06-b571-35d4b1045ce4 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:59:58.283481 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-c9618c4c-ed8e-4d06-b571-35d4b1045ce4 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:59:58.285783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell0:SELECT=2 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:59:58.290573 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c9618c4c-ed8e-4d06-b571-35d4b1045ce4 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:58.291057 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c9618c4c-ed8e-4d06-b571-35d4b1045ce4 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:58.291815 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c9618c4c-ed8e-4d06-b571-35d4b1045ce4 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:58.292242 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-c9618c4c-ed8e-4d06-b571-35d4b1045ce4 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:58.420108 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-c9618c4c-ed8e-4d06-b571-35d4b1045ce4 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:59:58.427369 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-c9618c4c-ed8e-4d06-b571-35d4b1045ce4 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1266 microversion: 2.1 time: 0.148275 Jun 16 19:59:58.427918 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 689/1359] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:59:58 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:59:59.443419 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d3dfb9c5-56b8-4cfe-8f7b-06c7ce7c03a7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:59:59.444030 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d3dfb9c5-56b8-4cfe-8f7b-06c7ce7c03a7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:59:59.450910 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d3dfb9c5-56b8-4cfe-8f7b-06c7ce7c03a7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:59.453460 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d3dfb9c5-56b8-4cfe-8f7b-06c7ce7c03a7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:59.453460 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d3dfb9c5-56b8-4cfe-8f7b-06c7ce7c03a7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:59:59.453460 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d3dfb9c5-56b8-4cfe-8f7b-06c7ce7c03a7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:59:59.589077 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d3dfb9c5-56b8-4cfe-8f7b-06c7ce7c03a7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:59:59.596797 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d3dfb9c5-56b8-4cfe-8f7b-06c7ce7c03a7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1266 microversion: 2.1 time: 0.157246 Jun 16 19:59:59.597361 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 671/1360] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 19:59:59 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 20:00:00.613551 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-d9cf64df-a740-45e2-959b-2f576b855ab9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:00:00.614186 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-d9cf64df-a740-45e2-959b-2f576b855ab9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:00:00.620589 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d9cf64df-a740-45e2-959b-2f576b855ab9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:00:00.621036 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d9cf64df-a740-45e2-959b-2f576b855ab9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:00:00.621789 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d9cf64df-a740-45e2-959b-2f576b855ab9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:00:00.622218 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-d9cf64df-a740-45e2-959b-2f576b855ab9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:00:00.752752 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-d9cf64df-a740-45e2-959b-2f576b855ab9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 20:00:00.760903 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-d9cf64df-a740-45e2-959b-2f576b855ab9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1266 microversion: 2.1 time: 0.151252 Jun 16 20:00:00.761475 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 690/1361] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 20:00:00 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 20:00:01.778049 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1b2eaa3b-bc4c-4a09-b173-4d23f3b7cfa9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:00:01.778676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1b2eaa3b-bc4c-4a09-b173-4d23f3b7cfa9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:00:01.785047 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1b2eaa3b-bc4c-4a09-b173-4d23f3b7cfa9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:00:01.785499 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1b2eaa3b-bc4c-4a09-b173-4d23f3b7cfa9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:00:01.786253 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1b2eaa3b-bc4c-4a09-b173-4d23f3b7cfa9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:00:01.786687 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1b2eaa3b-bc4c-4a09-b173-4d23f3b7cfa9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:00:01.922365 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1b2eaa3b-bc4c-4a09-b173-4d23f3b7cfa9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 20:00:01.930114 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1b2eaa3b-bc4c-4a09-b173-4d23f3b7cfa9 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1266 microversion: 2.1 time: 0.155894 Jun 16 20:00:01.930688 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 672/1362] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 20:00:01 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 20:00:02.538303 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-31cb0f53-e1a0-4fc2-b523-becdfa9ae43b req-f9d2c44a-208b-4085-9227-55eadae067df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd66312-6e27-4f38-8a5c-ab922b0b3ba5", "name": "network-vif-plugged", "status": "completed", "tag": "d85ecb16-693d-41c7-bba8-7edd4c259667"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 20:00:02.553138 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-31cb0f53-e1a0-4fc2-b523-becdfa9ae43b req-f9d2c44a-208b-4085-9227-55eadae067df service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:00:02.553138 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-31cb0f53-e1a0-4fc2-b523-becdfa9ae43b req-f9d2c44a-208b-4085-9227-55eadae067df service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:00:02.558336 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-31cb0f53-e1a0-4fc2-b523-becdfa9ae43b req-f9d2c44a-208b-4085-9227-55eadae067df service nova] Creating event network-vif-plugged:d85ecb16-693d-41c7-bba8-7edd4c259667 for instance afd66312-6e27-4f38-8a5c-ab922b0b3ba5 on hv-cinder-84617 Jun 16 20:00:02.563407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-31cb0f53-e1a0-4fc2-b523-becdfa9ae43b req-f9d2c44a-208b-4085-9227-55eadae067df service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028737 Jun 16 20:00:02.563981 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 691/1363] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 20:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 20:00:02.947119 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e75efd07-419c-4c2f-a343-4750785aeb0c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:00:02.947744 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e75efd07-419c-4c2f-a343-4750785aeb0c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:00:02.957335 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e75efd07-419c-4c2f-a343-4750785aeb0c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:00:02.957335 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e75efd07-419c-4c2f-a343-4750785aeb0c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:00:02.957335 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e75efd07-419c-4c2f-a343-4750785aeb0c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:00:02.957335 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e75efd07-419c-4c2f-a343-4750785aeb0c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:00:03.091545 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e75efd07-419c-4c2f-a343-4750785aeb0c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 20:00:03.099057 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e75efd07-419c-4c2f-a343-4750785aeb0c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1266 microversion: 2.1 time: 0.155876 Jun 16 20:00:03.099609 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 673/1364] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 20:00:02 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 20:00:04.118274 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-812452ce-c4a1-433c-b7d5-383bbf354e7c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:00:04.118887 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-812452ce-c4a1-433c-b7d5-383bbf354e7c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:00:04.125085 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-812452ce-c4a1-433c-b7d5-383bbf354e7c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:00:04.125531 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-812452ce-c4a1-433c-b7d5-383bbf354e7c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:00:04.126284 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-812452ce-c4a1-433c-b7d5-383bbf354e7c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:00:04.126719 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-812452ce-c4a1-433c-b7d5-383bbf354e7c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:00:04.264316 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-812452ce-c4a1-433c-b7d5-383bbf354e7c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 20:00:04.271690 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-812452ce-c4a1-433c-b7d5-383bbf354e7c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1266 microversion: 2.1 time: 0.158721 Jun 16 20:00:04.272249 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 692/1365] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 20:00:04 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 20:00:05.287881 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b0e061cd-010b-43d6-849a-54a4e0682dda tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:00:05.289017 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b0e061cd-010b-43d6-849a-54a4e0682dda tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:00:05.295402 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b0e061cd-010b-43d6-849a-54a4e0682dda tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:00:05.295844 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b0e061cd-010b-43d6-849a-54a4e0682dda tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:00:05.296592 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b0e061cd-010b-43d6-849a-54a4e0682dda tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:00:05.297017 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b0e061cd-010b-43d6-849a-54a4e0682dda tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:00:05.428928 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b0e061cd-010b-43d6-849a-54a4e0682dda tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 20:00:05.436759 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b0e061cd-010b-43d6-849a-54a4e0682dda tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1452 microversion: 2.1 time: 0.152661 Jun 16 20:00:05.437316 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 674/1366] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 20:00:05 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 20:00:05.453263 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6f54c1db-47be-421e-9484-c5519d446905 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:00:05.453869 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6f54c1db-47be-421e-9484-c5519d446905 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:00:05.460262 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6f54c1db-47be-421e-9484-c5519d446905 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:00:05.460702 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6f54c1db-47be-421e-9484-c5519d446905 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:00:05.461456 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6f54c1db-47be-421e-9484-c5519d446905 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:00:05.461889 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6f54c1db-47be-421e-9484-c5519d446905 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:00:05.593365 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6f54c1db-47be-421e-9484-c5519d446905 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 20:00:05.600784 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6f54c1db-47be-421e-9484-c5519d446905 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1452 microversion: 2.1 time: 0.151624 Jun 16 20:00:05.601347 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 693/1367] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 20:00:05 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 20:00:07.748150 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-9ba0eaef-fb7b-4464-9297-4b4d27bd54ab req-9586b0e0-22cc-464d-9131-ff525ffd965f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afd66312-6e27-4f38-8a5c-ab922b0b3ba5", "tag": "d85ecb16-693d-41c7-bba8-7edd4c259667"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 20:00:07.761079 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-9ba0eaef-fb7b-4464-9297-4b4d27bd54ab req-9586b0e0-22cc-464d-9131-ff525ffd965f service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:00:07.761524 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-9ba0eaef-fb7b-4464-9297-4b4d27bd54ab req-9586b0e0-22cc-464d-9131-ff525ffd965f service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:00:07.773984 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-9ba0eaef-fb7b-4464-9297-4b4d27bd54ab req-9586b0e0-22cc-464d-9131-ff525ffd965f service nova] Creating event network-changed:d85ecb16-693d-41c7-bba8-7edd4c259667 for instance afd66312-6e27-4f38-8a5c-ab922b0b3ba5 on hv-cinder-84617 Jun 16 20:00:07.783553 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-9ba0eaef-fb7b-4464-9297-4b4d27bd54ab req-9586b0e0-22cc-464d-9131-ff525ffd965f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034660 Jun 16 20:00:07.783553 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 675/1368] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 20:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 20:00:26.938059 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:00:26.938780 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Thu Jun 16 20:00:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 20:00:31.318555 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:00:31.319116 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Thu Jun 16 20:00:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 20:01:47.779971 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_api:SELECT=22 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:01:47.780738 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG dbcounter [-] [124551] Writing DB stats nova_cell1:SELECT=50 {{(pid=124551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:01:47.783597 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:01:47.784484 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=54 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:01:47.785175 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-632473de-e146-4486-ba80-7f83ce5684d5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:01:47.785676 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-632473de-e146-4486-ba80-7f83ce5684d5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:01:47.793707 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-632473de-e146-4486-ba80-7f83ce5684d5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:47.794158 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-632473de-e146-4486-ba80-7f83ce5684d5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:47.794948 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-632473de-e146-4486-ba80-7f83ce5684d5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:47.795407 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-632473de-e146-4486-ba80-7f83ce5684d5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:47.823936 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-632473de-e146-4486-ba80-7f83ce5684d5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Going to try to terminate instance {{(pid=124551) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 20:01:47.844804 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-d5cd9009-7728-441d-9d1a-441717235d7d req-dfc0f3df-ec13-40cf-8050-90899684c7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afd66312-6e27-4f38-8a5c-ab922b0b3ba5", "tag": "d85ecb16-693d-41c7-bba8-7edd4c259667"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 20:01:47.853105 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-d5cd9009-7728-441d-9d1a-441717235d7d req-dfc0f3df-ec13-40cf-8050-90899684c7e2 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:47.853638 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-d5cd9009-7728-441d-9d1a-441717235d7d req-dfc0f3df-ec13-40cf-8050-90899684c7e2 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:47.865362 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-d5cd9009-7728-441d-9d1a-441717235d7d req-dfc0f3df-ec13-40cf-8050-90899684c7e2 service nova] Creating event network-changed:d85ecb16-693d-41c7-bba8-7edd4c259667 for instance afd66312-6e27-4f38-8a5c-ab922b0b3ba5 on hv-cinder-84617 Jun 16 20:01:47.870817 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-d5cd9009-7728-441d-9d1a-441717235d7d req-dfc0f3df-ec13-40cf-8050-90899684c7e2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089933 Jun 16 20:01:47.871711 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 676/1369] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 20:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 20:01:48.146131 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-632473de-e146-4486-ba80-7f83ce5684d5 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "DELETE /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 204 len: 0 microversion: 2.1 time: 0.368084 Jun 16 20:01:48.147023 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 694/1370] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 20:01:47 2022] DELETE /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 20:01:48.157525 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3d820478-b9f7-4676-83da-701dbf410fcf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:01:48.160856 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3d820478-b9f7-4676-83da-701dbf410fcf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:01:48.171551 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d820478-b9f7-4676-83da-701dbf410fcf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:48.172052 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d820478-b9f7-4676-83da-701dbf410fcf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:48.172861 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d820478-b9f7-4676-83da-701dbf410fcf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:48.173302 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d820478-b9f7-4676-83da-701dbf410fcf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:48.322699 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3d820478-b9f7-4676-83da-701dbf410fcf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 20:01:48.331373 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3d820478-b9f7-4676-83da-701dbf410fcf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1577 microversion: 2.1 time: 0.179513 Jun 16 20:01:48.331941 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 677/1371] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 20:01:48 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 20:01:49.350473 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-287150f7-fdb6-4ff1-96d6-b6c7f2af2130 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:01:49.351331 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-287150f7-fdb6-4ff1-96d6-b6c7f2af2130 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:01:49.357665 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-287150f7-fdb6-4ff1-96d6-b6c7f2af2130 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:49.358118 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-287150f7-fdb6-4ff1-96d6-b6c7f2af2130 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:49.358888 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-287150f7-fdb6-4ff1-96d6-b6c7f2af2130 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:49.359952 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-287150f7-fdb6-4ff1-96d6-b6c7f2af2130 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:49.500351 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-287150f7-fdb6-4ff1-96d6-b6c7f2af2130 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 20:01:49.508079 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-287150f7-fdb6-4ff1-96d6-b6c7f2af2130 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1577 microversion: 2.1 time: 0.161757 Jun 16 20:01:49.508860 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 695/1372] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 20:01:49 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 20:01:50.506145 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-6ff3b551-b9c3-452f-b6ed-e6e8498bdc9a req-eb311bed-549f-4a97-8eac-37daccea2092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd66312-6e27-4f38-8a5c-ab922b0b3ba5", "name": "network-vif-deleted", "tag": "d85ecb16-693d-41c7-bba8-7edd4c259667"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 20:01:50.514595 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-6ff3b551-b9c3-452f-b6ed-e6e8498bdc9a req-eb311bed-549f-4a97-8eac-37daccea2092 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:50.515075 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-6ff3b551-b9c3-452f-b6ed-e6e8498bdc9a req-eb311bed-549f-4a97-8eac-37daccea2092 service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:50.524796 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-a8a3427d-f2b1-4fc6-b557-5e54bcfa450a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:01:50.525445 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-a8a3427d-f2b1-4fc6-b557-5e54bcfa450a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:01:50.526411 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-6ff3b551-b9c3-452f-b6ed-e6e8498bdc9a req-eb311bed-549f-4a97-8eac-37daccea2092 service nova] Creating event network-vif-deleted:d85ecb16-693d-41c7-bba8-7edd4c259667 for instance afd66312-6e27-4f38-8a5c-ab922b0b3ba5 on hv-cinder-84617 Jun 16 20:01:50.532031 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-6ff3b551-b9c3-452f-b6ed-e6e8498bdc9a req-eb311bed-549f-4a97-8eac-37daccea2092 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029186 Jun 16 20:01:50.532483 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a8a3427d-f2b1-4fc6-b557-5e54bcfa450a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:50.532613 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 678/1373] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 20:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 20:01:50.532938 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a8a3427d-f2b1-4fc6-b557-5e54bcfa450a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:50.533705 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a8a3427d-f2b1-4fc6-b557-5e54bcfa450a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:50.534227 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-a8a3427d-f2b1-4fc6-b557-5e54bcfa450a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:50.599348 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-a8a3427d-f2b1-4fc6-b557-5e54bcfa450a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 20:01:50.607480 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-a8a3427d-f2b1-4fc6-b557-5e54bcfa450a tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1391 microversion: 2.1 time: 0.086505 Jun 16 20:01:50.608059 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 696/1374] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 20:01:50 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1391 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 20:01:51.625748 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5ed0a705-c8b1-4fdd-9419-86b657ad3258 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:01:51.626480 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5ed0a705-c8b1-4fdd-9419-86b657ad3258 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:01:51.632660 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5ed0a705-c8b1-4fdd-9419-86b657ad3258 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:51.633109 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5ed0a705-c8b1-4fdd-9419-86b657ad3258 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:51.633866 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5ed0a705-c8b1-4fdd-9419-86b657ad3258 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:51.634302 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5ed0a705-c8b1-4fdd-9419-86b657ad3258 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:51.664391 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5ed0a705-c8b1-4fdd-9419-86b657ad3258 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:51.664838 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5ed0a705-c8b1-4fdd-9419-86b657ad3258 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:51.665288 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-5ed0a705-c8b1-4fdd-9419-86b657ad3258 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lazy-loading 'fault' on Instance uuid afd66312-6e27-4f38-8a5c-ab922b0b3ba5 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 20:01:51.710420 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5ed0a705-c8b1-4fdd-9419-86b657ad3258 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 20:01:51.717856 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5ed0a705-c8b1-4fdd-9419-86b657ad3258 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 200 len: 1231 microversion: 2.1 time: 0.097290 Jun 16 20:01:51.718957 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 679/1375] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 20:01:51 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 20:01:52.735643 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8ec36e4c-b1d1-4646-9f7a-c529ffb85d78 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:01:52.736285 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-8ec36e4c-b1d1-4646-9f7a-c529ffb85d78 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: afd66312-6e27-4f38-8a5c-ab922b0b3ba5] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:01:52.742221 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8ec36e4c-b1d1-4646-9f7a-c529ffb85d78 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:52.742665 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8ec36e4c-b1d1-4646-9f7a-c529ffb85d78 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:52.743455 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8ec36e4c-b1d1-4646-9f7a-c529ffb85d78 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:52.743891 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-8ec36e4c-b1d1-4646-9f7a-c529ffb85d78 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:52.756737 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-8ec36e4c-b1d1-4646-9f7a-c529ffb85d78 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] HTTP exception thrown: Instance afd66312-6e27-4f38-8a5c-ab922b0b3ba5 could not be found. Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8ec36e4c-b1d1-4646-9f7a-c529ffb85d78 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Request method failure captured: Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 HTTP/1.1 Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4qJ-mDowd0vMRoMinbGeRpffdfRvenT_O4XWSRu-sy8pnrWl1pABx4k5q78F7c-QnjbowXZ7vS5bah_6QCnslOK3_GquBdBHnTTDrNoO5PnnTUXSIoIu3X_oLuWswnZR30xI393MjmE19tgo1Lpn3nNW23r58IcvL_oDIy5ZT0k_Y4 Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 6e652ff475764534b6cc03cb64b7d069 Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-TestVolumeBootPattern-69831965 Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 20:01:52.758359 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 20:01:52.760191 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e652ff475764534b6cc03cb64b7d069"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6e652ff475764534b6cc03cb64b7d069"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6e652ff475764534b6cc03cb64b7d069", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e652ff475764534b6cc03cb64b7d069"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 20:01:52.760191 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-TestVolumeBootPattern-69831965 Jun 16 20:01:52.760191 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 6e652ff475764534b6cc03cb64b7d069 Jun 16 20:01:52.760191 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-TestVolumeBootPattern-69831965 Jun 16 20:01:52.760191 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-TestVolumeBootPattern-69831965-project Jun 16 20:01:52.760191 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 20:01:52.760191 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 20:01:52.760191 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 19fc9ffd436d4068a89686da8b4f2997 Jun 16 20:01:52.760191 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-TestVolumeBootPattern-69831965-project Jun 16 20:01:52.760191 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 20:01:52.760191 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance afd66312-6e27-4f38-8a5c-ab922b0b3ba5 could not be found. Jun 16 20:01:52.760191 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': 'afd66312-6e27-4f38-8a5c-ab922b0b3ba5'} Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afd66312-6e27-4f38-8a5c-ab922b0b3ba5 could not be found. Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 20:01:52.761207 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 20:01:52.762939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 20:01:52.762939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 20:01:52.762939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 20:01:52.762939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 20:01:52.762939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 20:01:52.762939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 20:01:52.762939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 20:01:52.762939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afd66312-6e27-4f38-8a5c-ab922b0b3ba5 could not be found. Jun 16 20:01:52.762939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 20:01:52.762939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 20:01:52.762939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 20:01:52.762939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 20:01:52.762939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 20:01:52.762939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 20:01:52.762939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 20:01:52.762939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 20:01:52.762939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afd66312-6e27-4f38-8a5c-ab922b0b3ba5 could not be found. Jun 16 20:01:52.762939 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 20:01:52.764610 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-8ec36e4c-b1d1-4646-9f7a-c529ffb85d78 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Returning 404 to user: Instance afd66312-6e27-4f38-8a5c-ab922b0b3ba5 could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 20:01:52.764610 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-8ec36e4c-b1d1-4646-9f7a-c529ffb85d78 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5" status: 404 len: 111 microversion: 2.1 time: 0.028116 Jun 16 20:01:52.764610 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 697/1376] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 20:01:52 2022] GET /compute/v2.1/servers/afd66312-6e27-4f38-8a5c-ab922b0b3ba5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 20:01:56.087921 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3eccd07d-b038-479f-9a38-a71d74497e37 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:01:56.088450 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3eccd07d-b038-479f-9a38-a71d74497e37 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:01:56.091659 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-76bfcc7c-cd00-4173-8260-ad914517ab9c req-b69df891-f9c9-4150-8b02-5642f6459d1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8db2f00-89b3-4ac1-97b3-1a105e3c2428", "tag": "905498af-f13a-4575-a0a1-dbf42535dcf6"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 20:01:56.095637 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3eccd07d-b038-479f-9a38-a71d74497e37 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:56.099716 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3eccd07d-b038-479f-9a38-a71d74497e37 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:56.099716 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3eccd07d-b038-479f-9a38-a71d74497e37 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:56.099716 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3eccd07d-b038-479f-9a38-a71d74497e37 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:56.102203 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-76bfcc7c-cd00-4173-8260-ad914517ab9c req-b69df891-f9c9-4150-8b02-5642f6459d1e service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:56.102753 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-76bfcc7c-cd00-4173-8260-ad914517ab9c req-b69df891-f9c9-4150-8b02-5642f6459d1e service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:56.115095 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-76bfcc7c-cd00-4173-8260-ad914517ab9c req-b69df891-f9c9-4150-8b02-5642f6459d1e service nova] Creating event network-changed:905498af-f13a-4575-a0a1-dbf42535dcf6 for instance d8db2f00-89b3-4ac1-97b3-1a105e3c2428 on hv-cinder-84617 Jun 16 20:01:56.120626 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-76bfcc7c-cd00-4173-8260-ad914517ab9c req-b69df891-f9c9-4150-8b02-5642f6459d1e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032400 Jun 16 20:01:56.121633 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 698/1377] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 20:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 20:01:56.128855 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3eccd07d-b038-479f-9a38-a71d74497e37 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Going to try to terminate instance {{(pid=124550) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 20:01:56.435183 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3eccd07d-b038-479f-9a38-a71d74497e37 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 204 len: 0 microversion: 2.1 time: 0.351024 Jun 16 20:01:56.436193 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 680/1378] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 20:01:56 2022] DELETE /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 20:01:56.445165 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-0b221f3b-66a6-4ef9-8a3b-2e735d06fd57 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:01:56.445893 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-0b221f3b-66a6-4ef9-8a3b-2e735d06fd57 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:01:56.452440 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0b221f3b-66a6-4ef9-8a3b-2e735d06fd57 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:56.452886 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0b221f3b-66a6-4ef9-8a3b-2e735d06fd57 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:56.453711 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0b221f3b-66a6-4ef9-8a3b-2e735d06fd57 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:56.454638 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-0b221f3b-66a6-4ef9-8a3b-2e735d06fd57 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:56.590835 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-0b221f3b-66a6-4ef9-8a3b-2e735d06fd57 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 20:01:56.598975 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-0b221f3b-66a6-4ef9-8a3b-2e735d06fd57 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1577 microversion: 2.1 time: 0.158394 Jun 16 20:01:56.599739 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 699/1379] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 20:01:56 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 20:01:57.616215 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-086ba966-f7f3-4b20-919f-0cd79bdb83a6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:01:57.616931 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-086ba966-f7f3-4b20-919f-0cd79bdb83a6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:01:57.623402 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-086ba966-f7f3-4b20-919f-0cd79bdb83a6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:57.623854 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-086ba966-f7f3-4b20-919f-0cd79bdb83a6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:57.624617 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-086ba966-f7f3-4b20-919f-0cd79bdb83a6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:57.625054 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-086ba966-f7f3-4b20-919f-0cd79bdb83a6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:57.812982 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-086ba966-f7f3-4b20-919f-0cd79bdb83a6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 20:01:57.821240 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-086ba966-f7f3-4b20-919f-0cd79bdb83a6 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1577 microversion: 2.1 time: 0.209251 Jun 16 20:01:57.821815 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 681/1380] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 20:01:57 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1577 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 20:01:58.721641 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [req-02b48d59-755a-4bc0-837e-6394d6d11287 req-eb02ccb4-6e71-4dc3-bb96-38ec1aee157a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8db2f00-89b3-4ac1-97b3-1a105e3c2428", "name": "network-vif-deleted", "tag": "905498af-f13a-4575-a0a1-dbf42535dcf6"}]} {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 20:01:58.729240 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-02b48d59-755a-4bc0-837e-6394d6d11287 req-eb02ccb4-6e71-4dc3-bb96-38ec1aee157a service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:58.729677 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [req-02b48d59-755a-4bc0-837e-6394d6d11287 req-eb02ccb4-6e71-4dc3-bb96-38ec1aee157a service nova] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:58.740768 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.compute.server_external_events [req-02b48d59-755a-4bc0-837e-6394d6d11287 req-eb02ccb4-6e71-4dc3-bb96-38ec1aee157a service nova] Creating event network-vif-deleted:905498af-f13a-4575-a0a1-dbf42535dcf6 for instance d8db2f00-89b3-4ac1-97b3-1a105e3c2428 on hv-cinder-84617 Jun 16 20:01:58.745650 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [req-02b48d59-755a-4bc0-837e-6394d6d11287 req-eb02ccb4-6e71-4dc3-bb96-38ec1aee157a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028627 Jun 16 20:01:58.746255 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 700/1381] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Jun 16 20:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 20:01:58.839237 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1e193e3b-571c-4d7d-80f7-d176b2d919ad tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:01:58.840529 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1e193e3b-571c-4d7d-80f7-d176b2d919ad tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:01:58.847305 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1e193e3b-571c-4d7d-80f7-d176b2d919ad tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:58.847754 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1e193e3b-571c-4d7d-80f7-d176b2d919ad tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:58.848521 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1e193e3b-571c-4d7d-80f7-d176b2d919ad tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:58.848956 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1e193e3b-571c-4d7d-80f7-d176b2d919ad tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:58.909902 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1e193e3b-571c-4d7d-80f7-d176b2d919ad tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 20:01:58.917677 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1e193e3b-571c-4d7d-80f7-d176b2d919ad tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1391 microversion: 2.1 time: 0.083832 Jun 16 20:01:58.920221 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 682/1382] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 20:01:58 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1391 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 20:01:59.935920 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-6898c3d9-0fa8-47e8-9960-b791402b46ed tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:01:59.936634 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-6898c3d9-0fa8-47e8-9960-b791402b46ed tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:01:59.943934 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6898c3d9-0fa8-47e8-9960-b791402b46ed tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:59.944319 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6898c3d9-0fa8-47e8-9960-b791402b46ed tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:59.945121 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6898c3d9-0fa8-47e8-9960-b791402b46ed tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:59.945560 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6898c3d9-0fa8-47e8-9960-b791402b46ed tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:59.975880 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6898c3d9-0fa8-47e8-9960-b791402b46ed tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:01:59.976325 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-6898c3d9-0fa8-47e8-9960-b791402b46ed tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:01:59.976769 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.objects.instance [None req-6898c3d9-0fa8-47e8-9960-b791402b46ed tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lazy-loading 'fault' on Instance uuid d8db2f00-89b3-4ac1-97b3-1a105e3c2428 {{(pid=124551) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 20:02:00.018073 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.policy [None req-6898c3d9-0fa8-47e8-9960-b791402b46ed tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9ffd436d4068a89686da8b4f2997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e652ff475764534b6cc03cb64b7d069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124551) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 20:02:00.024954 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-6898c3d9-0fa8-47e8-9960-b791402b46ed tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 200 len: 1185 microversion: 2.1 time: 0.093216 Jun 16 20:02:00.025526 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 701/1383] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 20:01:59 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 1185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 20:02:01.041371 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4d6a05af-08ae-4e37-aa34-774f1bacec5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:02:01.041974 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4d6a05af-08ae-4e37-aa34-774f1bacec5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: d8db2f00-89b3-4ac1-97b3-1a105e3c2428] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:02:01.048433 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4d6a05af-08ae-4e37-aa34-774f1bacec5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:02:01.048883 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4d6a05af-08ae-4e37-aa34-774f1bacec5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:02:01.049647 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4d6a05af-08ae-4e37-aa34-774f1bacec5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:02:01.050087 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4d6a05af-08ae-4e37-aa34-774f1bacec5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:02:01.062788 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-4d6a05af-08ae-4e37-aa34-774f1bacec5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] HTTP exception thrown: Instance d8db2f00-89b3-4ac1-97b3-1a105e3c2428 could not be found. Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4d6a05af-08ae-4e37-aa34-774f1bacec5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Request method failure captured: Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 HTTP/1.1 Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4qJ-mDowd0vMRoMinbGeRpffdfRvenT_O4XWSRu-sy8pnrWl1pABx4k5q78F7c-QnjbowXZ7vS5bah_6QCnslOK3_GquBdBHnTTDrNoO5PnnTUXSIoIu3X_oLuWswnZR30xI393MjmE19tgo1Lpn3nNW23r58IcvL_oDIy5ZT0k_Y4 Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 6e652ff475764534b6cc03cb64b7d069 Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-TestVolumeBootPattern-69831965 Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 20:02:01.064435 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 20:02:01.066178 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e652ff475764534b6cc03cb64b7d069"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6e652ff475764534b6cc03cb64b7d069"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6e652ff475764534b6cc03cb64b7d069", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e652ff475764534b6cc03cb64b7d069"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 20:02:01.066178 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-TestVolumeBootPattern-69831965 Jun 16 20:02:01.066178 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 6e652ff475764534b6cc03cb64b7d069 Jun 16 20:02:01.066178 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-TestVolumeBootPattern-69831965 Jun 16 20:02:01.066178 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-TestVolumeBootPattern-69831965-project Jun 16 20:02:01.066178 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 20:02:01.066178 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 20:02:01.066178 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 19fc9ffd436d4068a89686da8b4f2997 Jun 16 20:02:01.066178 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-TestVolumeBootPattern-69831965-project Jun 16 20:02:01.066178 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 20:02:01.066178 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance d8db2f00-89b3-4ac1-97b3-1a105e3c2428 could not be found. Jun 16 20:02:01.066178 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': 'd8db2f00-89b3-4ac1-97b3-1a105e3c2428'} Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8db2f00-89b3-4ac1-97b3-1a105e3c2428 could not be found. Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 20:02:01.067236 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 20:02:01.068968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 20:02:01.068968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 20:02:01.068968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 20:02:01.068968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 20:02:01.068968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 20:02:01.068968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 20:02:01.068968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 20:02:01.068968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8db2f00-89b3-4ac1-97b3-1a105e3c2428 could not be found. Jun 16 20:02:01.068968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 20:02:01.068968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 20:02:01.068968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 20:02:01.068968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 20:02:01.068968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 20:02:01.068968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 20:02:01.068968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 20:02:01.068968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 20:02:01.068968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8db2f00-89b3-4ac1-97b3-1a105e3c2428 could not be found. Jun 16 20:02:01.068968 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 20:02:01.070476 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4d6a05af-08ae-4e37-aa34-774f1bacec5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Returning 404 to user: Instance d8db2f00-89b3-4ac1-97b3-1a105e3c2428 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 20:02:01.070476 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4d6a05af-08ae-4e37-aa34-774f1bacec5c tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428" status: 404 len: 111 microversion: 2.1 time: 0.028363 Jun 16 20:02:01.070476 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 683/1384] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 20:02:01 2022] GET /compute/v2.1/servers/d8db2f00-89b3-4ac1-97b3-1a105e3c2428 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 20:02:01.560136 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bf754387-226c-4d9d-84fc-9eccc05409c7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:02:01.560649 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.compute.api [None req-bf754387-226c-4d9d-84fc-9eccc05409c7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124551) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:02:01.567704 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bf754387-226c-4d9d-84fc-9eccc05409c7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:02:01.568159 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bf754387-226c-4d9d-84fc-9eccc05409c7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:02:01.568947 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bf754387-226c-4d9d-84fc-9eccc05409c7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:02:01.569422 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG oslo_concurrency.lockutils [None req-bf754387-226c-4d9d-84fc-9eccc05409c7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124551) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:02:01.584522 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.wsgi [None req-bf754387-226c-4d9d-84fc-9eccc05409c7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] HTTP exception thrown: Instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 could not be found. Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bf754387-226c-4d9d-84fc-9eccc05409c7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Request method failure captured: Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: request: DELETE /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 HTTP/1.1 Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept: application/json Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Accept-Encoding: identity Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Connection: close Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Length: 0 Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Content-Type: application/json Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Host: 10.222.0.36 Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Openstack-System-Scope: None Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: User-Agent: python-urllib3/1.26.9 Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Auth-Token: gAAAAABiq4qJ-mDowd0vMRoMinbGeRpffdfRvenT_O4XWSRu-sy8pnrWl1pABx4k5q78F7c-QnjbowXZ7vS5bah_6QCnslOK3_GquBdBHnTTDrNoO5PnnTUXSIoIu3X_oLuWswnZR30xI393MjmE19tgo1Lpn3nNW23r58IcvL_oDIy5ZT0k_Y4 Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Id: None Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Domain-Name: None Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Identity-Status: Confirmed Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Is-Admin-Project: True Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Id: default Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Domain-Name: Default Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Id: 6e652ff475764534b6cc03cb64b7d069 Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Project-Name: tempest-TestVolumeBootPattern-69831965 Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Role: reader,member Jun 16 20:02:01.586128 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Roles: reader,member Jun 16 20:02:01.588111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e652ff475764534b6cc03cb64b7d069"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6e652ff475764534b6cc03cb64b7d069"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6e652ff475764534b6cc03cb64b7d069", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e652ff475764534b6cc03cb64b7d069"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 20:02:01.588111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant: tempest-TestVolumeBootPattern-69831965 Jun 16 20:02:01.588111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Id: 6e652ff475764534b6cc03cb64b7d069 Jun 16 20:02:01.588111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-Tenant-Name: tempest-TestVolumeBootPattern-69831965 Jun 16 20:02:01.588111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User: tempest-TestVolumeBootPattern-69831965-project Jun 16 20:02:01.588111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Id: default Jun 16 20:02:01.588111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Domain-Name: Default Jun 16 20:02:01.588111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Id: 19fc9ffd436d4068a89686da8b4f2997 Jun 16 20:02:01.588111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: X-User-Name: tempest-TestVolumeBootPattern-69831965-project Jun 16 20:02:01.588111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: method: > Jun 16 20:02:01.588111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: exception: Instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 could not be found. Jun 16 20:02:01.588111 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: action_args: {'id': 'c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1'} Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 could not be found. Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 20:02:01.589125 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 could not be found. Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 could not be found. Jun 16 20:02:01.590783 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR nova.api.openstack.wsgi Jun 16 20:02:01.592509 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-bf754387-226c-4d9d-84fc-9eccc05409c7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Returning 404 to user: Instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 could not be found. {{(pid=124551) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 20:02:01.592509 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-bf754387-226c-4d9d-84fc-9eccc05409c7 tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 404 len: 111 microversion: 2.1 time: 0.031370 Jun 16 20:02:01.592509 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 702/1385] 10.222.0.36 () {58 vars in 1238 bytes} [Thu Jun 16 20:02:01 2022] DELETE /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 20:02:01.597673 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-84e3ef47-9e71-43d6-898d-1df01436b2bf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:02:01.598287 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-84e3ef47-9e71-43d6-898d-1df01436b2bf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [instance: c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 20:02:01.604245 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84e3ef47-9e71-43d6-898d-1df01436b2bf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:02:01.604700 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84e3ef47-9e71-43d6-898d-1df01436b2bf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:02:01.605457 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84e3ef47-9e71-43d6-898d-1df01436b2bf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 20:02:01.605892 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84e3ef47-9e71-43d6-898d-1df01436b2bf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Lock "cb00b46e-9042-4ea9-a634-b4f1cf1f3046" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 20:02:01.619384 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-84e3ef47-9e71-43d6-898d-1df01436b2bf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] HTTP exception thrown: Instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 could not be found. Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-84e3ef47-9e71-43d6-898d-1df01436b2bf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Request method failure captured: Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 HTTP/1.1 Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept: application/json Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Connection: close Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Host: 10.222.0.36 Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABiq4qJ-mDowd0vMRoMinbGeRpffdfRvenT_O4XWSRu-sy8pnrWl1pABx4k5q78F7c-QnjbowXZ7vS5bah_6QCnslOK3_GquBdBHnTTDrNoO5PnnTUXSIoIu3X_oLuWswnZR30xI393MjmE19tgo1Lpn3nNW23r58IcvL_oDIy5ZT0k_Y4 Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Id: 6e652ff475764534b6cc03cb64b7d069 Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-TestVolumeBootPattern-69831965 Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jun 16 20:02:01.620901 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jun 16 20:02:01.622658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e652ff475764534b6cc03cb64b7d069"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6e652ff475764534b6cc03cb64b7d069"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6e652ff475764534b6cc03cb64b7d069", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6e652ff475764534b6cc03cb64b7d069"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 16 20:02:01.622658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-TestVolumeBootPattern-69831965 Jun 16 20:02:01.622658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 6e652ff475764534b6cc03cb64b7d069 Jun 16 20:02:01.622658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-TestVolumeBootPattern-69831965 Jun 16 20:02:01.622658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User: tempest-TestVolumeBootPattern-69831965-project Jun 16 20:02:01.622658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jun 16 20:02:01.622658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jun 16 20:02:01.622658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Id: 19fc9ffd436d4068a89686da8b4f2997 Jun 16 20:02:01.622658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-TestVolumeBootPattern-69831965-project Jun 16 20:02:01.622658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: method: > Jun 16 20:02:01.622658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: exception: Instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 could not be found. Jun 16 20:02:01.622658 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: action_args: {'id': 'c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1'} Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 could not be found. Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 20:02:01.623676 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 20:02:01.625325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 20:02:01.625325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 20:02:01.625325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 20:02:01.625325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 20:02:01.625325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 20:02:01.625325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 20:02:01.625325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 20:02:01.625325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 could not be found. Jun 16 20:02:01.625325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 20:02:01.625325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 20:02:01.625325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 20:02:01.625325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 20:02:01.625325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 20:02:01.625325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 20:02:01.625325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 20:02:01.625325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 20:02:01.625325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 could not be found. Jun 16 20:02:01.625325 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jun 16 20:02:01.626845 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-84e3ef47-9e71-43d6-898d-1df01436b2bf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Returning 404 to user: Instance c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 20:02:01.626845 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-84e3ef47-9e71-43d6-898d-1df01436b2bf tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1" status: 404 len: 111 microversion: 2.1 time: 0.028368 Jun 16 20:02:01.626845 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 684/1386] 10.222.0.36 () {58 vars in 1235 bytes} [Thu Jun 16 20:02:01 2022] GET /compute/v2.1/servers/c3cd374f-8e82-4f0a-b3be-0ca0fa131ca1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 20:02:03.112693 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: DEBUG nova.api.openstack.wsgi [None req-79d79e8d-905d-4015-80a9-597a1d77610d tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] Calling method '.version_select at 0x7f0505cb49d0>' {{(pid=124551) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 20:02:03.115942 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: ERROR oslo.messaging._drivers.impl_rabbit [None req-79d79e8d-905d-4015-80a9-597a1d77610d tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [a92cb0e4-2d5c-49ec-8b2a-fb32881905e4] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 20:02:04.123692 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO oslo.messaging._drivers.impl_rabbit [None req-79d79e8d-905d-4015-80a9-597a1d77610d tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] [a92cb0e4-2d5c-49ec-8b2a-fb32881905e4] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 35690. Jun 16 20:02:04.195742 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO nova.api.openstack.requestlog [None req-79d79e8d-905d-4015-80a9-597a1d77610d tempest-TestVolumeBootPattern-69831965 tempest-TestVolumeBootPattern-69831965-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1913068007" status: 202 len: 0 microversion: 2.1 time: 1.086846 Jun 16 20:02:04.196325 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: [pid: 124551|app: 0|req: 703/1387] 10.222.0.36 () {58 vars in 1262 bytes} [Thu Jun 16 20:02:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1913068007 => generated 0 bytes in 1088 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 20:02:14.215045 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:02:14.215609 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Thu Jun 16 20:02:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 20:03:46.946414 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:03:46.947167 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Thu Jun 16 20:03:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 20:03:51.327578 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:03:51.328106 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Thu Jun 16 20:03:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 20:04:05.113149 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:04:05.113723 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Thu Jun 16 20:04:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 20:04:08.140836 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:04:08.141429 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Thu Jun 16 20:04:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 20:05:24.135644 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:05:24.136398 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Thu Jun 16 20:05:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 20:05:34.225143 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:05:34.225693 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Thu Jun 16 20:05:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 20:07:06.955231 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:07:06.955961 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Thu Jun 16 20:07:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 20:07:11.335999 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:07:11.336441 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Thu Jun 16 20:07:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 20:07:25.120942 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:07:25.121592 dv-cinder-846173-1-iscsi devstack@n-api.service[124550]: Thu Jun 16 20:07:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 20:07:28.149693 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 20:07:28.150376 dv-cinder-846173-1-iscsi devstack@n-api.service[124551]: Thu Jun 16 20:07:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!